Regresión softmax


In [1]:
%matplotlib inline
import numpy as np
import matplotlib.pyplot as plt
from scipy.optimize import minimize
from IPython.display import Image  # Esto es para desplegar imágenes en la libreta

1. La base de datos a utilizar

La regresión softmax (o tambien conocida como regresión logística multinomial) es el último de los algoritmos basado en modelos lineales generalizados que cubriremos en el curso de reconocimiento de patrones. Para ejemplificar su uso, vamos a utilizar una base de datos bastante comun, MNIST.

MNIST es una base de datos de digitos escritos a mano, en formato de $20 \times 20$ pixeles. La base completa puede obtenerse en la página de Yan LeCun (http://yann.lecun.com/exdb/mnist/).

Nosotros en realidad vamos a utilizar una base de datos reducida de la original y con imágenes de calidad más reducida ($16 \times 16$ pixeles por imagen). Numpy provée un método para guardad objetos tipo numpy en un solo archivo, utilizando el método de compresión gunzip. Los datos ya se encuentran preprocesados y empaquetados en un archivo llamado digitos.npz.


In [2]:
data = np.load("digitos.npz")

print data.keys()


['X_valida', 'X_entrena', 'T_valida', 'T_entrena']

En este caso, data es un objeto contenedor de numpy cuyas llaves son X_valida, X_entrena, T_valida, T_entrena. Cada una de estas son a su vez objetos tipo ndarray de numpy, los cuales contienen valores de entrada y salida, tantopara entrenamiento como para validación. No se preocupen, esto de entrenamiento y validación lo vamos a ver más adelante en la clase.

Cada renglon de x es una imagen desenrrollada, esto es los 256 datos de una imágen de $16 \times 16$ pixeles. Por otra parte, cada renglon de y es un vector de 10 posiciones, donde todos los valores son ceros, salvo uno, que es el que define la clase de la imagen.

Para darse una mejor idea, ejecuta el siguiente script varias veces.


In [3]:
x = data['X_entrena']
y = data['T_entrena']

a = np.random.randint(0, y.shape[0])

print "-- x es de dimensiones ", x.shape
print "-- y es de dimensiones ", y.shape

print "\ny si escogemos la imagen ", a, "veremos"

plt.imshow(x[a,:].reshape(16,16), cmap=plt.gray())
plt.axis('off')
plt.show()

print "la cual es un", list(y[a,:]).index(1)

print"\n\nY si miramos lo que contiene, veremos que"
print"x[a,:] = "
print x[a,:]
print "y[a,:] = "
print y[a,:]


-- x es de dimensiones  (9000, 256)
-- y es de dimensiones  (9000, 10)

y si escogemos la imagen  4651 veremos
la cual es un 1


Y si miramos lo que contiene, veremos que
x[a,:] = 
[ 0.          0.          0.          0.          0.          0.          0.
  0.          0.          0.          0.05490196  0.09411766  0.69803923
  0.69803923  0.51764709  0.07843138  0.          0.          0.          0.
  0.          0.          0.          0.          0.          0.07450981
  0.67843139  1.          1.          1.          1.          0.19607845
  0.          0.          0.          0.          0.          0.          0.
  0.          0.11764707  0.75294125  1.          1.          1.          1.
  0.4666667   0.02352941  0.          0.          0.          0.          0.
  0.          0.          0.          0.50588238  1.          1.          1.
  1.          0.84705889  0.24705884  0.          0.          0.          0.
  0.          0.          0.          0.          0.          1.          1.
  1.          1.          0.96470594  0.49411768  0.          0.          0.
  0.          0.          0.          0.          0.          0.
  0.45490199  1.          1.          1.          1.          0.7960785   0.
  0.          0.          0.          0.          0.          0.          0.
  0.          0.          0.80000007  1.          1.          1.          1.
  0.50980395  0.          0.          0.          0.          0.          0.
  0.          0.          0.          0.45490199  0.95294124  1.          1.
  1.          0.99607849  0.          0.          0.          0.          0.
  0.          0.          0.          0.          0.10196079  0.7019608   1.
  1.          1.          1.          0.99607849  0.          0.          0.
  0.          0.          0.          0.          0.          0.
  0.40000004  1.          1.          1.          1.          1.          0.2392157
  0.          0.          0.          0.          0.          0.          0.
  0.          0.14901961  0.84313732  1.          1.          1.          1.
  0.73725492  0.10980393  0.          0.          0.          0.          0.
  0.          0.          0.          0.627451    1.          1.          1.
  1.          0.90588242  0.30588236  0.          0.          0.          0.
  0.          0.          0.          0.01568628  0.74901962  1.          1.
  1.          1.          0.87450987  0.22352943  0.          0.          0.
  0.          0.          0.          0.          0.04705883  0.64705884
  1.          1.          1.          1.          1.          0.22352943
  0.          0.          0.          0.          0.          0.          0.
  0.05882353  0.58039218  1.          1.          1.          1.          0.8705883
  0.3019608   0.          0.          0.          0.          0.          0.
  0.          0.          0.          0.15686275  0.38823533  0.38823533
  0.63137257  0.26666668  0.03529412  0.          0.          0.          0.
  0.          0.          0.          0.          0.        ]
y[a,:] = 
[ 0.  1.  0.  0.  0.  0.  0.  0.  0.  0.]

O bien, ejecuta este script para ver un grupo grande de imágenes (puedes hacer más grande la imagen para verla mejor).


In [4]:
indices = np.arange(y.shape[0])
np.random.shuffle(indices)
ind = indices[0:100].reshape(10,10)

imagen = np.ones((10 * 16 + 4*11, 10 * 16 + 4*11))
for i in range(10):
    for j in range(10):
        imagen[4 + i * 20: 20 + i * 20, 4 + j * 20: 20 + j * 20] = x[ind[i, j], :].reshape(16,16)
        
plt.imshow(imagen, cmap=plt.gray())
plt.axis('off')
plt.title(u"Ejemplos aleatorios de imágenes a clasificar")


Out[4]:
<matplotlib.text.Text at 0x7f15bec6ea90>

Por último, vamos a hacer una función que agregue la hilera de unos para la x extendida, y simplificar más adelante su uso.


In [5]:
def extendida(x):
    """
    Agrega una columna de unos a x
    
    """
    return np.c_[np.ones((x.shape[0], 1)), x]

2. Regresión softmax

En la regresión softmax en lugar de estimar solamente un vector de parámetros, lo que tenemos que hacer es estimar una matriz de parámetros $\theta$ tal que:

$$ \theta = (\theta_1, \ldots, \theta_K) $$

donde $\theta_k = (\theta_{k, 0}, \ldots, \theta_{k, n})^T$ es el vector columna que parametriza la clase $k$. De esta manera, $\theta$ es ahora una matriz de dimensión $K \times n+1$. El aporte lineal a cada clase de un objeto $x^{(i)}$ está dado por

$$ z^{(i)} = \theta x^{(i)} = (z^{(i)}_1, \ldots, z^{(i)}_K)^T $$

el cual es de dimensión $K \times 1$ (un valor por cada clase). La probabilidad de pertenecer a la clase $c$ está dada por:

$$ \hat{y}_c^{(i)} = softmax_k(z^{(i)}) = \frac{\exp(z_c^{(i)})}{\sum_{r=1}^K \exp(z_r^{(i)})}. $$

Como se puede ver, $\hat{y}^{(i)}$ en realizad es el vector de las exponenciales de $z^{(i)}$ normalizadas.

Ejercicio 1. Con esta información, realiza la función softmax, de manera que si recibe un ndarray de dimensiones $ T \times K$ con $T$ vectores, regrese la matriz de mismas dimensiones con el cálculo softmax para cada matriz (20 puntos).


In [24]:
def softmax(z):
    """
    Calculo de la regresión softmax
    
    @param z: ndarray de dimensión (T, K) donde z[i, :] es el vector de aportes lineales de el objeto i
    
    @return: un ndarray de dimensión (T, K) donde cada columna es el calculo softmax de su respectivo vector de entrada.
    
    """
    #--------------------------------------------------------------------------------
    # AGREGA AQUI TU CÓDIGO
    #--------------------------------------------------------------------------------
    
    a = np.exp(z)
    
    return a / a.sum(axis=1).reshape(-1,1)
    
    '''
    R = z.shape[0]
    C = z.shape[1]
    
    fuckyou = np.zeros_like(z)
    for i in xrange(R):
        for j in xrange(C):
            fuckyou[i][j] = np.exp(z[i][j])/np.sum(np.exp(z[i]))
            
    return fuckyou
    '''
    #--------------------------------------------------------------------------------

def test_softmax():
    z = np.array([[1, 0.1, -10], [20, 100, 2.5], [2, 2.1, 2.2]])
    y_hat = softmax(z)
    y_selec = y_hat.argmax(axis=1)
    y_hat_acc = y_hat.sum(axis=1) 


    assert abs(y_hat_acc[0] - 1) < 1e-10
    assert abs(y_hat_acc[1] - 1) < 1e-10
    assert abs(y_hat_acc[2] - 1) < 1e-10

    assert y_selec[0] == 0
    assert y_selec[2] == 2
    
    return "Paso la prueba"

print test_softmax()


Paso la prueba

Y ahora es necesario implementar la función de costo, la cual es:

$$ J(\theta) = -\frac{1}{T}\sum_{i=1}^T \sum_{c=1}^K y_c^{(i)} \log(\hat{y}_c^{(i)}), $$

donde $y_c^{(i)}$ es un valor de 0 o 1 dependiendo si el objeto $i$ pertenece a la clase $c$ o no, mientras que $\hat{y}_c^{(i)}$ es la probabilidad que el objeto $i$ pertenezca a la clase $c$ conociendo $x^{(i)}$ y parametrizado por $\theta$. Este criterio se derivó de una distribución de la familia exponencial en clase y no se detalla en la libreta.

Ejercicio 2. Implementa la función de costo de manera relativamente eficiente, utilizando las facilidades que presenta numpy (10 puntos)


In [13]:
def costo(theta, x, y):
    """
    Calcula el costo para la regresión softmax parametrizada por theta, 
    con el conjunto de datos dado por (x, y)
    
    @param theta: ndarray de dimensión (n+1, K) con los parámetros
    @param x: ndarray de dimensión (T, n+1) con los datos
    @param y: ndarray de dimensión (T, K) con la clase por cada dato
    
    @return: Un valor flotante
    
    """
    yhat = softmax(x.dot(theta))
    return -(1.0/y.shape[0]) * np.sum(y * np.log(yhat))
    
    '''
    costo = 0
    T = 0
    K = 0
    for i in xrange(x.shape[0]):
        K = 0
        for k in xrange(y.shape[1]):
            K += y[i][k]*np.log(softmax(x.dot(theta)))[i][k]
        T += K
        
    
    #return -np.sum(y*np.log(softmax(x.dot(theta))))/T
    return -T/x.shape[0]
    #--------------------------------------------------------------------------------
    # AGREGA AQUI TU CÓDIGO
    #--------------------------------------------------------------------------------




    '''
    #--------------------------------------------------------------------------------

def test_costo():
    x = np.array([[1, 0, 0], [1, 0, 1], [1, 1, 0], [1, 1, 1]])
    y = np.eye(4)

    theta = np.array([[3, -4, -4],[-1, -1, 3], [.01, 3, -10], [-5, 5, 5]]).T
    
    assert costo(theta, x, y) < 0.1
    return "Paso la prueba"
    
print test_costo()


[[  9.35507482e-01   1.71344172e-02   4.70442733e-02   3.13827798e-04]
 [  4.20098461e-02   8.43790316e-01   5.23653124e-06   1.14194601e-01]
 [  1.68824720e-02   6.21071436e-03   9.31015497e-01   4.58913168e-02]
 [  4.45810978e-05   1.79852985e-02   6.09403213e-06   9.81964026e-01]]
Paso la prueba

Ejercicio 3. Implementa la función para predecir el valor de y estimada sin tener que calcular la función softmax (10 puntos)


In [20]:
def predice(theta, x):
    """
    Prediccion de y_hat a partir de la matriz theta para los valores de x
    
    @param theta: ndarray de dimensión (n+1, K) con los parámetros
    @param x: ndarray de dimensión (T, n+1) con los datos

    @return: ndarray de dimensión (T, K) con la clase por cada dato (unos y ceros)
    
    """
    z = x.dot(theta)
    indices = np.argmax(z, axis = 1)
    a = np.zeros_like(z)
    a[range(a.shape[0]), indices] = 1
    
    #for i in xrange(a.shape[0]):
    #    a[i][indices[i]] = 1
    return a
    #--------------------------------------------------------------------------------
    # AGREGA AQUI TU CÓDIGO
    #--------------------------------------------------------------------------------
    
    
    #--------------------------------------------------------------------------------

def prueba_prediccion():
    x = np.array([[1, 0, 0], [1, 0, 1], [1, 1, 0], [1, 1, 1]])
    y = np.eye(4)

    theta = np.array([[3, -4, -4],[-1, -1, 3], [.01, 3, -10], [-5, 5, 5]]).T
    
    assert abs((y - predice(theta, x)).sum()) < 1e-12 
    return "Paso la prueba"
    
print prueba_prediccion()


[[ 1.  0.  0.  0.]
 [ 0.  1.  0.  0.]
 [ 0.  0.  1.  0.]
 [ 0.  0.  0.  1.]]
Paso la prueba

Y por último tenemos que implementar el gradiente para poder utilizar los métodos de optimización (ya sea por descenso de gradiente o por algún método de optimización.

El gradiente se obtiene a partir de las derivadas parciales:

$$ \frac{\partial J(\theta)}{\partial \theta_{s, r}} = - \frac{1}{T} \sum_{i = 1}^T \left(y_k^{(i)} - \sum_{j=1}^K \hat{y}_j^{i}\right) x_s^{(i)}, $$

donde $k$ es la clase a la que pertenece el ejemplo $i$. Esto implica que cuando $k = r$, entonces solamente tenemos $1 - \hat{y}_k^{(i)}$ para este dato. Si $k \neq r$ entonces tendremos $-\hat{y}_r^{(i)}$.

Esto se puede resolver en forma matricial como

$$ \nabla J(\theta) = - \frac{1}{T} X^T (Y - \hat{Y}) $$

Ejercicio 4. Implementa el gradiente de la manera que menos se dificulte (15 puntos)


In [15]:
def gradiente(theta, x, y):
    """
    Calculo del gradiente para el problema de regresión softmax
    
    @param theta: ndarray de dimensión (n+1, K) con los parámetros
    @param x: ndarray de dimensión (T, n+1) con los datos
    @param y: ndarray de dimensión (T, K) con la clase por cada dato
    
    @return: Un ndarray de mismas dimensiones que theta
    
    """
    #--------------------------------------------------------------------------------
    # AGREGA AQUI TU CÓDIGO
    #--------------------------------------------------------------------------------

    return -1.*(x.T.dot(y - softmax(x.dot(theta))))/x.shape[0]



    #--------------------------------------------------------------------------------

def prueba_gradiente():
    x = np.array([[1, 0, 0], [1, 0, 1], [1, 1, 0], [1, 1, 1]])
    y = np.eye(4)

    theta = np.array([[3, -4, -4],[-1, -1, 3], [.01, 3, -10], [-5, 5, 5]]).T
    
    g = gradiente(theta, x, y)
    assert np.abs(g).max() < 0.05
    
    return "Paso la prueba"
    
print prueba_gradiente()


[[  9.35507482e-01   1.71344172e-02   4.70442733e-02   3.13827798e-04]
 [  4.20098461e-02   8.43790316e-01   5.23653124e-06   1.14194601e-01]
 [  1.68824720e-02   6.21071436e-03   9.31015497e-01   4.58913168e-02]
 [  4.45810978e-05   1.79852985e-02   6.09403213e-06   9.81964026e-01]]
Paso la prueba

Ahora si, ya nos encontramos en capacidad para realizar el aprendizaje para la regresión softmax.

Ejercicio 5. Implementa la regresión softmax utilizando el método de descenso de gradiente (15 puntos)


In [16]:
def dg_softmax_lotes(theta, x, y, alpha=None, max_epoch=10000, epsilon=1e-3, errores=False):
    """
    Descenso de gradiente por lotes para la clasificación softmax
    
    """
    historial = np.zeros((max_epoch)) if errores else None
    for epoch in xrange(max_epoch):
        #--------------------------------------------------------------------------------
        # AGREGA AQUI TU CÓDIGO
        #--------------------------------------------------------------------------------
        inc = gradiente(theta, x, y)
        if np.abs(inc.max()) <= epsilon:
            return theta, historial
        theta -= alpha*inc
        if errores:
            historial[epoch] = costo(theta, x, y)

        #--------------------------------------------------------------------------------
    return theta, historial

Pero para utilizar el descenso de gradiente hay que ajustar un valor de $\alpha$.


In [17]:
# Ajusta un valor de alpha razonable

alfita = 1

T, K = y.shape
n = x.shape[1]

theta = 0.1 * (np.random.random((n + 1, K)) - 0.5)
theta, e_hist = dg_softmax_lotes(theta, extendida(x), y, alpha=alfita, max_epoch=100, errores=True)
plt.plot(e_hist)


[[ 0.09998209  0.07762913  0.08583507 ...,  0.0937731   0.11783465
   0.09721395]
 [ 0.09454434  0.08605378  0.08950766 ...,  0.11270964  0.09694972
   0.12306051]
 [ 0.08560267  0.07169643  0.08455104 ...,  0.09734353  0.12827092
   0.13315714]
 ..., 
 [ 0.07859053  0.08639056  0.1023714  ...,  0.10307705  0.08916269
   0.13713622]
 [ 0.08447356  0.09287647  0.12686358 ...,  0.08617105  0.10176122
   0.10976579]
 [ 0.07029525  0.09079905  0.12084971 ...,  0.08665504  0.09362374
   0.14318016]]
[[ 0.45052369  0.06089571  0.04990893 ...,  0.02565767  0.0910368
   0.02290426]
 [ 0.12334502  0.13759401  0.08415795 ...,  0.06754362  0.16691562
   0.0837523 ]
 [ 0.26652789  0.04860263  0.08357321 ...,  0.07334924  0.16358093
   0.06291287]
 ..., 
 [ 0.0705528   0.18765163  0.07524683 ...,  0.14624736  0.11220156
   0.12854607]
 [ 0.23535466  0.10672297  0.08444297 ...,  0.04790427  0.19375376
   0.07251382]
 [ 0.10593127  0.10286058  0.08949924 ...,  0.10109382  0.1255872
   0.16342999]]
[[ 0.45052369  0.06089571  0.04990893 ...,  0.02565767  0.0910368
   0.02290426]
 [ 0.12334502  0.13759401  0.08415795 ...,  0.06754362  0.16691562
   0.0837523 ]
 [ 0.26652789  0.04860263  0.08357321 ...,  0.07334924  0.16358093
   0.06291287]
 ..., 
 [ 0.0705528   0.18765163  0.07524683 ...,  0.14624736  0.11220156
   0.12854607]
 [ 0.23535466  0.10672297  0.08444297 ...,  0.04790427  0.19375376
   0.07251382]
 [ 0.10593127  0.10286058  0.08949924 ...,  0.10109382  0.1255872
   0.16342999]]
[[ 0.12773488  0.04813154  0.10342447 ...,  0.02776059  0.10211082
   0.03253232]
 [ 0.01486787  0.09429404  0.11615518 ...,  0.05999939  0.17079632
   0.11592023]
 [ 0.038342    0.02101599  0.17899504 ...,  0.11957368  0.16860249
   0.10054091]
 ..., 
 [ 0.01359882  0.14861936  0.07456344 ...,  0.2407973   0.08761347
   0.18765719]
 [ 0.03298739  0.05476099  0.12446634 ...,  0.0568202   0.25494706
   0.15451446]
 [ 0.01265289  0.04142707  0.08538917 ...,  0.13223127  0.08448975
   0.28951226]]
[[ 0.12773488  0.04813154  0.10342447 ...,  0.02776059  0.10211082
   0.03253232]
 [ 0.01486787  0.09429404  0.11615518 ...,  0.05999939  0.17079632
   0.11592023]
 [ 0.038342    0.02101599  0.17899504 ...,  0.11957368  0.16860249
   0.10054091]
 ..., 
 [ 0.01359882  0.14861936  0.07456344 ...,  0.2407973   0.08761347
   0.18765719]
 [ 0.03298739  0.05476099  0.12446634 ...,  0.0568202   0.25494706
   0.15451446]
 [ 0.01265289  0.04142707  0.08538917 ...,  0.13223127  0.08448975
   0.28951226]]
[[ 0.73800694  0.02468426  0.02511635 ...,  0.00607467  0.04760549
   0.00543475]
 [ 0.0462187   0.15446111  0.08891126 ...,  0.04213403  0.27233682
   0.06872667]
 [ 0.29173125  0.01826388  0.1177674  ...,  0.09165285  0.20689067
   0.04111149]
 ..., 
 [ 0.02455043  0.21978477  0.0500098  ...,  0.28938826  0.0982192
   0.12890143]
 [ 0.22388078  0.05570937  0.05861701 ...,  0.03240019  0.38403335
   0.07534643]
 [ 0.04911578  0.05200611  0.05721988 ...,  0.14630609  0.11577009
   0.2265018 ]]
[[ 0.73800694  0.02468426  0.02511635 ...,  0.00607467  0.04760549
   0.00543475]
 [ 0.0462187   0.15446111  0.08891126 ...,  0.04213403  0.27233682
   0.06872667]
 [ 0.29173125  0.01826388  0.1177674  ...,  0.09165285  0.20689067
   0.04111149]
 ..., 
 [ 0.02455043  0.21978477  0.0500098  ...,  0.28938826  0.0982192
   0.12890143]
 [ 0.22388078  0.05570937  0.05861701 ...,  0.03240019  0.38403335
   0.07534643]
 [ 0.04911578  0.05200611  0.05721988 ...,  0.14630609  0.11577009
   0.2265018 ]]
[[ 0.13288302  0.02799933  0.09480207 ...,  0.00963167  0.08384812
   0.01353234]
 [ 0.00435088  0.08757181  0.12531348 ...,  0.02960793  0.21839678
   0.08446155]
 [ 0.02227941  0.00833519  0.27289068 ...,  0.10726573  0.19326961
   0.0629844 ]
 ..., 
 [ 0.00539865  0.12679309  0.05975017 ...,  0.37018883  0.07454527
   0.18449921]
 [ 0.0194373   0.02466101  0.10446348 ...,  0.03077423  0.42354096
   0.1529249 ]
 [ 0.00496087  0.01932567  0.06211085 ...,  0.13087267  0.07072543
   0.33618544]]
[[ 0.13288302  0.02799933  0.09480207 ...,  0.00963167  0.08384812
   0.01353234]
 [ 0.00435088  0.08757181  0.12531348 ...,  0.02960793  0.21839678
   0.08446155]
 [ 0.02227941  0.00833519  0.27289068 ...,  0.10726573  0.19326961
   0.0629844 ]
 ..., 
 [ 0.00539865  0.12679309  0.05975017 ...,  0.37018883  0.07454527
   0.18449921]
 [ 0.0194373   0.02466101  0.10446348 ...,  0.03077423  0.42354096
   0.1529249 ]
 [ 0.00496087  0.01932567  0.06211085 ...,  0.13087267  0.07072543
   0.33618544]]
[[ 0.81924827  0.01571036  0.01820573 ...,  0.00247972  0.03743656
   0.00248898]
 [ 0.01611405  0.1715564   0.08419025 ...,  0.02488643  0.33976542
   0.05235107]
 [ 0.22555389  0.01053532  0.16071567 ...,  0.10472994  0.26990595
   0.0313402 ]
 ..., 
 [ 0.01064255  0.18811272  0.03587058 ...,  0.43112091  0.07993548
   0.11945594]
 [ 0.15072875  0.0295806   0.04096567 ...,  0.02043478  0.57408218
   0.07312799]
 [ 0.02260933  0.02957505  0.03716488 ...,  0.15503416  0.09889524
   0.24557827]]
[[ 0.81924827  0.01571036  0.01820573 ...,  0.00247972  0.03743656
   0.00248898]
 [ 0.01611405  0.1715564   0.08419025 ...,  0.02488643  0.33976542
   0.05235107]
 [ 0.22555389  0.01053532  0.16071567 ...,  0.10472994  0.26990595
   0.0313402 ]
 ..., 
 [ 0.01064255  0.18811272  0.03587058 ...,  0.43112091  0.07993548
   0.11945594]
 [ 0.15072875  0.0295806   0.04096567 ...,  0.02043478  0.57408218
   0.07312799]
 [ 0.02260933  0.02957505  0.03716488 ...,  0.15503416  0.09889524
   0.24557827]]
[[ 0.29198485  0.02343394  0.07438973 ...,  0.00462215  0.06788133
   0.0075311 ]
 [ 0.00287764  0.11947078  0.11924044 ...,  0.0181761   0.2468806
   0.06728096]
 [ 0.03181171  0.0058464   0.3301322  ...,  0.10478462  0.21296961
   0.04648516]
 ..., 
 [ 0.00370452  0.1177866   0.04412101 ...,  0.47994618  0.05851697
   0.16790666]
 [ 0.02639476  0.01680356  0.07485411 ...,  0.01934179  0.54538096
   0.1506874 ]
 [ 0.0043543   0.01437344  0.0430324  ...,  0.12864582  0.06081407
   0.36486954]]
[[ 0.29198485  0.02343394  0.07438973 ...,  0.00462215  0.06788133
   0.0075311 ]
 [ 0.00287764  0.11947078  0.11924044 ...,  0.0181761   0.2468806
   0.06728096]
 [ 0.03181171  0.0058464   0.3301322  ...,  0.10478462  0.21296961
   0.04648516]
 ..., 
 [ 0.00370452  0.1177866   0.04412101 ...,  0.47994618  0.05851697
   0.16790666]
 [ 0.02639476  0.01680356  0.07485411 ...,  0.01934179  0.54538096
   0.1506874 ]
 [ 0.0043543   0.01437344  0.0430324  ...,  0.12864582  0.06081407
   0.36486954]]
[[ 0.82777983  0.01151852  0.01748344 ...,  0.00135177  0.03416453
   0.00150421]
 [ 0.00663973  0.18536041  0.08236976 ...,  0.01483825  0.36375696
   0.03730841]
 [ 0.15768652  0.00647098  0.21762993 ...,  0.10101616  0.31096536
   0.02254962]
 ..., 
 [ 0.00581142  0.14525706  0.03001835 ...,  0.54088992  0.0671806
   0.10581212]
 [ 0.09701529  0.01537511  0.03232428 ...,  0.01247875  0.70083753
   0.06300334]
 [ 0.01293877  0.01921048  0.02964961 ...,  0.14983575  0.09092538
   0.24541463]]
[[ 0.82777983  0.01151852  0.01748344 ...,  0.00135177  0.03416453
   0.00150421]
 [ 0.00663973  0.18536041  0.08236976 ...,  0.01483825  0.36375696
   0.03730841]
 [ 0.15768652  0.00647098  0.21762993 ...,  0.10101616  0.31096536
   0.02254962]
 ..., 
 [ 0.00581142  0.14525706  0.03001835 ...,  0.54088992  0.0671806
   0.10581212]
 [ 0.09701529  0.01537511  0.03232428 ...,  0.01247875  0.70083753
   0.06300334]
 [ 0.01293877  0.01921048  0.02964961 ...,  0.14983575  0.09092538
   0.24541463]]
[[ 0.5259409   0.01783374  0.04680073 ...,  0.00210915  0.04626945
   0.00379134]
 [ 0.00245978  0.18024428  0.10651487 ...,  0.01206223  0.26234413
   0.05276821]
 [ 0.0504972   0.00491738  0.35785204 ...,  0.10047495  0.22916529
   0.03485236]
 ..., 
 [ 0.00298767  0.1119156   0.03302803 ...,  0.56200833  0.04682031
   0.14732823]
 [ 0.03973475  0.01308143  0.05235306 ...,  0.01288712  0.62758297
   0.13917725]
 [ 0.00476195  0.01289019  0.03097394 ...,  0.12602714  0.05587922
   0.37772735]]
[[ 0.5259409   0.01783374  0.04680073 ...,  0.00210915  0.04626945
   0.00379134]
 [ 0.00245978  0.18024428  0.10651487 ...,  0.01206223  0.26234413
   0.05276821]
 [ 0.0504972   0.00491738  0.35785204 ...,  0.10047495  0.22916529
   0.03485236]
 ..., 
 [ 0.00298767  0.1119156   0.03302803 ...,  0.56200833  0.04682031
   0.14732823]
 [ 0.03973475  0.01308143  0.05235306 ...,  0.01288712  0.62758297
   0.13917725]
 [ 0.00476195  0.01289019  0.03097394 ...,  0.12602714  0.05587922
   0.37772735]]
[[ 0.79075824  0.01046728  0.02086703 ...,  0.00097914  0.03684762
   0.00122824]
 [ 0.0031224   0.21040725  0.08121862 ...,  0.0095383   0.36482895
   0.02842696]
 [ 0.09800677  0.00431818  0.28223398 ...,  0.09342876  0.33218138
   0.01728698]
 ..., 
 [ 0.00340597  0.11217271  0.02616369 ...,  0.62189261  0.05631397
   0.09620243]
 [ 0.05860463  0.00883359  0.0274072  ...,  0.00820016  0.7788588
   0.05736418]
 [ 0.0078943   0.01394805  0.02540976 ...,  0.14329488  0.08525738
   0.25405435]]
[[ 0.79075824  0.01046728  0.02086703 ...,  0.00097914  0.03684762
   0.00122824]
 [ 0.0031224   0.21040725  0.08121862 ...,  0.0095383   0.36482895
   0.02842696]
 [ 0.09800677  0.00431818  0.28223398 ...,  0.09342876  0.33218138
   0.01728698]
 ..., 
 [ 0.00340597  0.11217271  0.02616369 ...,  0.62189261  0.05631397
   0.09620243]
 [ 0.05860463  0.00883359  0.0274072  ...,  0.00820016  0.7788588
   0.05736418]
 [ 0.0078943   0.01394805  0.02540976 ...,  0.14329488  0.08525738
   0.25405435]]
[[ 0.69240045  0.01253372  0.02968455 ...,  0.00100002  0.03163648
   0.00189242]
 [ 0.00209568  0.25397292  0.09367387 ...,  0.00820524  0.27058295
   0.03926668]
 [ 0.06663842  0.00407809  0.37765305 ...,  0.09281007  0.24461922
   0.02527349]
 ..., 
 [ 0.00246096  0.10266131  0.02612206 ...,  0.62703143  0.03961601
   0.12661102]
 [ 0.0501478   0.00983683  0.03815488 ...,  0.00883484  0.69343497
   0.11872388]
 [ 0.00513008  0.01187091  0.02407328 ...,  0.12439136  0.05513908
   0.37306548]]
[[ 0.69240045  0.01253372  0.02968455 ...,  0.00100002  0.03163648
   0.00189242]
 [ 0.00209568  0.25397292  0.09367387 ...,  0.00820524  0.27058295
   0.03926668]
 [ 0.06663842  0.00407809  0.37765305 ...,  0.09281007  0.24461922
   0.02527349]
 ..., 
 [ 0.00246096  0.10266131  0.02612206 ...,  0.62703143  0.03961601
   0.12661102]
 [ 0.0501478   0.00983683  0.03815488 ...,  0.00883484  0.69343497
   0.11872388]
 [ 0.00513008  0.01187091  0.02407328 ...,  0.12439136  0.05513908
   0.37306548]]
[[  7.68398894e-01   9.20729102e-03   2.15537956e-02 ...,   6.94728530e-04
    3.52074345e-02   9.99465444e-04]
 [  1.84884092e-03   2.52883419e-01   7.69128324e-02 ...,   6.56512570e-03
    3.51061829e-01   2.32965385e-02]
 [  7.17705935e-02   3.15064832e-03   3.31225870e-01 ...,   8.57253111e-02
    3.34004384e-01   1.42249092e-02]
 ..., 
 [  2.26639691e-03   9.10253916e-02   2.24387757e-02 ...,   6.79575267e-01
    4.67715430e-02   9.02617396e-02]
 [  4.30171091e-02   5.81348765e-03   2.31503513e-02 ...,   5.85176510e-03
    8.16940377e-01   5.63354941e-02]
 [  5.75724731e-03   1.11961121e-02   2.15011665e-02 ...,   1.37652278e-01
    7.96200094e-02   2.73560715e-01]]
[[  7.68398894e-01   9.20729102e-03   2.15537956e-02 ...,   6.94728530e-04
    3.52074345e-02   9.99465444e-04]
 [  1.84884092e-03   2.52883419e-01   7.69128324e-02 ...,   6.56512570e-03
    3.51061829e-01   2.32965385e-02]
 [  7.17705935e-02   3.15064832e-03   3.31225870e-01 ...,   8.57253111e-02
    3.34004384e-01   1.42249092e-02]
 ..., 
 [  2.26639691e-03   9.10253916e-02   2.24387757e-02 ...,   6.79575267e-01
    4.67715430e-02   9.02617396e-02]
 [  4.30171091e-02   5.81348765e-03   2.31503513e-02 ...,   5.85176510e-03
    8.16940377e-01   5.63354941e-02]
 [  5.75724731e-03   1.11961121e-02   2.15011665e-02 ...,   1.37652278e-01
    7.96200094e-02   2.73560715e-01]]
[[  7.57807373e-01   9.49862481e-03   2.28831899e-02 ...,   5.76412122e-04
    2.57828303e-02   1.11724727e-03]
 [  1.55618262e-03   3.19908549e-01   8.26068580e-02 ...,   5.64823372e-03
    2.72585322e-01   2.82320277e-02]
 [  6.70773949e-02   3.19696155e-03   4.01476202e-01 ...,   8.37332468e-02
    2.59897030e-01   1.80715325e-02]
 ..., 
 [  1.92204725e-03   9.04394316e-02   2.18500501e-02 ...,   6.80626996e-01
    3.52177261e-02   1.08154742e-01]
 [  4.88496840e-02   6.94748865e-03   2.93272761e-02 ...,   6.20920146e-03
    7.53015798e-01   9.66295488e-02]
 [  4.88668990e-03   1.07033045e-02   2.01056048e-02 ...,   1.23785121e-01
    5.72302060e-02   3.58521092e-01]]
[[  7.57807373e-01   9.49862481e-03   2.28831899e-02 ...,   5.76412122e-04
    2.57828303e-02   1.11724727e-03]
 [  1.55618262e-03   3.19908549e-01   8.26068580e-02 ...,   5.64823372e-03
    2.72585322e-01   2.82320277e-02]
 [  6.70773949e-02   3.19696155e-03   4.01476202e-01 ...,   8.37332468e-02
    2.59897030e-01   1.80715325e-02]
 ..., 
 [  1.92204725e-03   9.04394316e-02   2.18500501e-02 ...,   6.80626996e-01
    3.52177261e-02   1.08154742e-01]
 [  4.88496840e-02   6.94748865e-03   2.93272761e-02 ...,   6.20920146e-03
    7.53015798e-01   9.66295488e-02]
 [  4.88668990e-03   1.07033045e-02   2.01056048e-02 ...,   1.23785121e-01
    5.72302060e-02   3.58521092e-01]]
[[  7.75563266e-01   7.80628792e-03   1.98268333e-02 ...,   4.71204627e-04
    3.02418528e-02   7.74096105e-04]
 [  1.26251433e-03   3.11849874e-01   7.11743702e-02 ...,   4.68075215e-03
    3.26913861e-01   1.95168981e-02]
 [  6.14863206e-02   2.48531903e-03   3.71271002e-01 ...,   7.87294051e-02
    3.26063863e-01   1.21418177e-02]
 ..., 
 [  1.66597385e-03   7.82554966e-02   1.93199961e-02 ...,   7.20343819e-01
    3.91332040e-02   8.56144790e-02]
 [  3.75498424e-02   4.30671112e-03   1.99339147e-02 ...,   4.45025114e-03
    8.36122178e-01   5.71872944e-02]
 [  4.79748871e-03   9.71138987e-03   1.82645142e-02 ...,   1.32577539e-01
    7.44518643e-02   2.95312064e-01]]
[[  7.75563266e-01   7.80628792e-03   1.98268333e-02 ...,   4.71204627e-04
    3.02418528e-02   7.74096105e-04]
 [  1.26251433e-03   3.11849874e-01   7.11743702e-02 ...,   4.68075215e-03
    3.26913861e-01   1.95168981e-02]
 [  6.14863206e-02   2.48531903e-03   3.71271002e-01 ...,   7.87294051e-02
    3.26063863e-01   1.21418177e-02]
 ..., 
 [  1.66597385e-03   7.82554966e-02   1.93199961e-02 ...,   7.20343819e-01
    3.91332040e-02   8.56144790e-02]
 [  3.75498424e-02   4.30671112e-03   1.99339147e-02 ...,   4.45025114e-03
    8.36122178e-01   5.71872944e-02]
 [  4.79748871e-03   9.71138987e-03   1.82645142e-02 ...,   1.32577539e-01
    7.44518643e-02   2.95312064e-01]]
[[  7.84747632e-01   7.61808724e-03   1.95127073e-02 ...,   3.80835571e-04
    2.31538894e-02   7.52171248e-04]
 [  1.10146291e-03   3.76312732e-01   7.26312394e-02 ...,   4.00438966e-03
    2.69290288e-01   2.06297146e-02]
 [  6.08514672e-02   2.46987479e-03   4.23852083e-01 ...,   7.60547576e-02
    2.73478705e-01   1.33721111e-02]
 ..., 
 [  1.48089702e-03   7.81740041e-02   1.87019423e-02 ...,   7.24727330e-01
    3.19685303e-02   9.34183341e-02]
 [  4.29687946e-02   4.83504536e-03   2.31103672e-02 ...,   4.53627561e-03
    8.00633146e-01   7.92752155e-02]
 [  4.43051430e-03   9.54618562e-03   1.72478587e-02 ...,   1.24046771e-01
    6.01702202e-02   3.45170553e-01]]
[[  7.84747632e-01   7.61808724e-03   1.95127073e-02 ...,   3.80835571e-04
    2.31538894e-02   7.52171248e-04]
 [  1.10146291e-03   3.76312732e-01   7.26312394e-02 ...,   4.00438966e-03
    2.69290288e-01   2.06297146e-02]
 [  6.08514672e-02   2.46987479e-03   4.23852083e-01 ...,   7.60547576e-02
    2.73478705e-01   1.33721111e-02]
 ..., 
 [  1.48089702e-03   7.81740041e-02   1.87019423e-02 ...,   7.24727330e-01
    3.19685303e-02   9.34183341e-02]
 [  4.29687946e-02   4.83504536e-03   2.31103672e-02 ...,   4.53627561e-03
    8.00633146e-01   7.92752155e-02]
 [  4.43051430e-03   9.54618562e-03   1.72478587e-02 ...,   1.24046771e-01
    6.01702202e-02   3.45170553e-01]]
[[  7.91715441e-01   6.61305658e-03   1.78555490e-02 ...,   3.23629745e-04
    2.54256991e-02   5.92996430e-04]
 [  9.06960688e-04   3.77423844e-01   6.52533024e-02 ...,   3.39701880e-03
    2.97474511e-01   1.61253619e-02]
 [  5.55192526e-02   2.02540241e-03   4.09171166e-01 ...,   7.21201979e-02
    3.13362877e-01   1.03498354e-02]
 ..., 
 [  1.29133643e-03   6.94657479e-02   1.69727587e-02 ...,   7.51258080e-01
    3.34067731e-02   8.07114215e-02]
 [  3.50091821e-02   3.39057107e-03   1.76755334e-02 ...,   3.53443342e-03
    8.48608220e-01   5.75402514e-02]
 [  4.24098020e-03   8.77132507e-03   1.58759635e-02 ...,   1.28560356e-01
    7.05030179e-02   3.12132147e-01]]
[[  7.91715441e-01   6.61305658e-03   1.78555490e-02 ...,   3.23629745e-04
    2.54256991e-02   5.92996430e-04]
 [  9.06960688e-04   3.77423844e-01   6.52533024e-02 ...,   3.39701880e-03
    2.97474511e-01   1.61253619e-02]
 [  5.55192526e-02   2.02540241e-03   4.09171166e-01 ...,   7.21201979e-02
    3.13362877e-01   1.03498354e-02]
 ..., 
 [  1.29133643e-03   6.94657479e-02   1.69727587e-02 ...,   7.51258080e-01
    3.34067731e-02   8.07114215e-02]
 [  3.50091821e-02   3.39057107e-03   1.76755334e-02 ...,   3.53443342e-03
    8.48608220e-01   5.75402514e-02]
 [  4.24098020e-03   8.77132507e-03   1.58759635e-02 ...,   1.28560356e-01
    7.05030179e-02   3.12132147e-01]]
[[  8.01050605e-01   6.28749243e-03   1.72267266e-02 ...,   2.68075030e-04
    2.12604095e-02   5.44528252e-04]
 [  7.86297933e-04   4.28323600e-01   6.40325371e-02 ...,   2.91245195e-03
    2.60353898e-01   1.55652158e-02]
 [  5.43714156e-02   1.93413179e-03   4.45050135e-01 ...,   6.94442727e-02
    2.82201611e-01   1.03476632e-02]
 ..., 
 [  1.16029921e-03   6.80274261e-02   1.62866806e-02 ...,   7.59189900e-01
    2.92266079e-02   8.24586829e-02]
 [  3.75311950e-02   3.46358373e-03   1.87455483e-02 ...,   3.44536273e-03
    8.34463077e-01   6.73795466e-02]
 [  4.01602035e-03   8.58409737e-03   1.50367302e-02 ...,   1.24193798e-01
    6.27990121e-02   3.37367435e-01]]
[[  8.01050605e-01   6.28749243e-03   1.72267266e-02 ...,   2.68075030e-04
    2.12604095e-02   5.44528252e-04]
 [  7.86297933e-04   4.28323600e-01   6.40325371e-02 ...,   2.91245195e-03
    2.60353898e-01   1.55652158e-02]
 [  5.43714156e-02   1.93413179e-03   4.45050135e-01 ...,   6.94442727e-02
    2.82201611e-01   1.03476632e-02]
 ..., 
 [  1.16029921e-03   6.80274261e-02   1.62866806e-02 ...,   7.59189900e-01
    2.92266079e-02   8.24586829e-02]
 [  3.75311950e-02   3.46358373e-03   1.87455483e-02 ...,   3.44536273e-03
    8.34463077e-01   6.73795466e-02]
 [  4.01602035e-03   8.58409737e-03   1.50367302e-02 ...,   1.24193798e-01
    6.27990121e-02   3.37367435e-01]]
[[  8.06742723e-01   5.64379915e-03   1.61480253e-02 ...,   2.30157662e-04
    2.17574294e-02   4.58391549e-04]
 [  6.63444040e-04   4.40486167e-01   5.92584630e-02 ...,   2.50502511e-03
    2.68758082e-01   1.31120762e-02]
 [  5.06174403e-02   1.66462632e-03   4.43666999e-01 ...,   6.61510332e-02
    3.00684674e-01   8.75365999e-03]
 ..., 
 [  1.02967970e-03   6.23888625e-02   1.51230371e-02 ...,   7.76658832e-01
    2.91839791e-02   7.54002620e-02]
 [  3.30343274e-02   2.72387941e-03   1.58437547e-02 ...,   2.88570768e-03
    8.59622414e-01   5.65608519e-02]
 [  3.84685676e-03   8.05746242e-03   1.40428818e-02 ...,   1.25981378e-01
    6.80375543e-02   3.22994362e-01]]
[[  8.06742723e-01   5.64379915e-03   1.61480253e-02 ...,   2.30157662e-04
    2.17574294e-02   4.58391549e-04]
 [  6.63444040e-04   4.40486167e-01   5.92584630e-02 ...,   2.50502511e-03
    2.68758082e-01   1.31120762e-02]
 [  5.06174403e-02   1.66462632e-03   4.43666999e-01 ...,   6.61510332e-02
    3.00684674e-01   8.75365999e-03]
 ..., 
 [  1.02967970e-03   6.23888625e-02   1.51230371e-02 ...,   7.76658832e-01
    2.91839791e-02   7.54002620e-02]
 [  3.30343274e-02   2.72387941e-03   1.58437547e-02 ...,   2.88570768e-03
    8.59622414e-01   5.65608519e-02]
 [  3.84685676e-03   8.05746242e-03   1.40428818e-02 ...,   1.25981378e-01
    6.80375543e-02   3.22994362e-01]]
[[  8.13907544e-01   5.29854334e-03   1.54862269e-02 ...,   1.95532496e-04
    1.94715913e-02   4.12438473e-04]
 [  5.72939022e-04   4.78199712e-01   5.68742110e-02 ...,   2.16141905e-03
    2.46187802e-01   1.20864325e-02]
 [  4.88960084e-02   1.54576484e-03   4.67257026e-01 ...,   6.35883980e-02
    2.84454175e-01   8.31274277e-03]
 ..., 
 [  9.30190881e-04   6.01446836e-02   1.44352930e-02 ...,   7.85822362e-01
    2.67597244e-02   7.43459180e-02]
 [  3.35066573e-02   2.59599128e-03   1.57756244e-02 ...,   2.72067495e-03
    8.57354707e-01   5.96269805e-02]
 [  3.68196215e-03   7.82921547e-03   1.33180359e-02 ...,   1.24011160e-01
    6.46001574e-02   3.34463250e-01]]
[[  8.13907544e-01   5.29854334e-03   1.54862269e-02 ...,   1.95532496e-04
    1.94715913e-02   4.12438473e-04]
 [  5.72939022e-04   4.78199712e-01   5.68742110e-02 ...,   2.16141905e-03
    2.46187802e-01   1.20864325e-02]
 [  4.88960084e-02   1.54576484e-03   4.67257026e-01 ...,   6.35883980e-02
    2.84454175e-01   8.31274277e-03]
 ..., 
 [  9.30190881e-04   6.01446836e-02   1.44352930e-02 ...,   7.85822362e-01
    2.67597244e-02   7.43459180e-02]
 [  3.35066573e-02   2.59599128e-03   1.57756244e-02 ...,   2.72067495e-03
    8.57354707e-01   5.96269805e-02]
 [  3.68196215e-03   7.82921547e-03   1.33180359e-02 ...,   1.24011160e-01
    6.46001574e-02   3.34463250e-01]]
[[  8.19192593e-01   4.85838700e-03   1.47074359e-02 ...,   1.69329010e-04
    1.91014296e-02   3.59669829e-04]
 [  4.91405658e-04   4.96930729e-01   5.34459831e-02 ...,   1.87632324e-03
    2.43489958e-01   1.05827428e-02]
 [  4.62017011e-02   1.37246439e-03   4.73887868e-01 ...,   6.08093801e-02
    2.89949934e-01   7.38064431e-03]
 ..., 
 [  8.37391825e-04   5.63619859e-02   1.36077081e-02 ...,   7.98079727e-01
    2.60544296e-02   7.01001892e-02]
 [  3.10719861e-02   2.20210061e-03   1.42084674e-02 ...,   2.39546050e-03
    8.70472816e-01   5.44150969e-02]
 [  3.54288761e-03   7.46693810e-03   1.25723042e-02 ...,   1.24534954e-01
    6.68729173e-02   3.29559690e-01]]
[[  8.19192593e-01   4.85838700e-03   1.47074359e-02 ...,   1.69329010e-04
    1.91014296e-02   3.59669829e-04]
 [  4.91405658e-04   4.96930729e-01   5.34459831e-02 ...,   1.87632324e-03
    2.43489958e-01   1.05827428e-02]
 [  4.62017011e-02   1.37246439e-03   4.73887868e-01 ...,   6.08093801e-02
    2.89949934e-01   7.38064431e-03]
 ..., 
 [  8.37391825e-04   5.63619859e-02   1.36077081e-02 ...,   7.98079727e-01
    2.60544296e-02   7.01001892e-02]
 [  3.10719861e-02   2.20210061e-03   1.42084674e-02 ...,   2.39546050e-03
    8.70472816e-01   5.44150969e-02]
 [  3.54288761e-03   7.46693810e-03   1.25723042e-02 ...,   1.24534954e-01
    6.68729173e-02   3.29559690e-01]]
[[  8.24810152e-01   4.54470444e-03   1.41010231e-02 ...,   1.46528709e-04
    1.77672645e-02   3.22468546e-04]
 [  4.25465046e-04   5.25638891e-01   5.08475851e-02 ...,   1.63168004e-03
    2.28871080e-01   9.58489379e-03]
 [  4.43320744e-02   1.25842152e-03   4.90545229e-01 ...,   5.84089412e-02
    2.81381348e-01   6.86108354e-03]
 ..., 
 [  7.61026881e-04   5.39723545e-02   1.29839747e-02 ...,   8.06868088e-01
    2.45374677e-02   6.80993860e-02]
 [  3.05948594e-02   2.02835377e-03   1.37086598e-02 ...,   2.22320524e-03
    8.73164827e-01   5.44515154e-02]
 [  3.41376913e-03   7.23400925e-03   1.19558164e-02 ...,   1.23718326e-01
    6.56508313e-02   3.34559320e-01]]
[[  8.24810152e-01   4.54470444e-03   1.41010231e-02 ...,   1.46528709e-04
    1.77672645e-02   3.22468546e-04]
 [  4.25465046e-04   5.25638891e-01   5.08475851e-02 ...,   1.63168004e-03
    2.28871080e-01   9.58489379e-03]
 [  4.43320744e-02   1.25842152e-03   4.90545229e-01 ...,   5.84089412e-02
    2.81381348e-01   6.86108354e-03]
 ..., 
 [  7.61026881e-04   5.39723545e-02   1.29839747e-02 ...,   8.06868088e-01
    2.45374677e-02   6.80993860e-02]
 [  3.05948594e-02   2.02835377e-03   1.37086598e-02 ...,   2.22320524e-03
    8.73164827e-01   5.44515154e-02]
 [  3.41376913e-03   7.23400925e-03   1.19558164e-02 ...,   1.23718326e-01
    6.56508313e-02   3.34559320e-01]]
[[  8.29557712e-01   4.22189304e-03   1.34923580e-02 ...,   1.28110506e-04
    1.71232669e-02   2.86809659e-04]
 [  3.68701377e-04   5.46320749e-01   4.80941551e-02 ...,   1.42668619e-03
    2.21590239e-01   8.54722802e-03]
 [  4.22249003e-02   1.13666773e-03   5.00661021e-01 ...,   5.60114558e-02
    2.80630003e-01   6.23839900e-03]
 ..., 
 [  6.92285759e-04   5.12035852e-02   1.23511373e-02 ...,   8.16182199e-01
    2.36597366e-02   6.51743452e-02]
 [  2.91487875e-02   1.79304369e-03   1.27613988e-02 ...,   2.01499138e-03
    8.80759116e-01   5.17081916e-02]
 [  3.29964323e-03   6.96633720e-03   1.13673839e-02 ...,   1.23804692e-01
    6.65511952e-02   3.33699995e-01]]
[[  8.29557712e-01   4.22189304e-03   1.34923580e-02 ...,   1.28110506e-04
    1.71232669e-02   2.86809659e-04]
 [  3.68701377e-04   5.46320749e-01   4.80941551e-02 ...,   1.42668619e-03
    2.21590239e-01   8.54722802e-03]
 [  4.22249003e-02   1.13666773e-03   5.00661021e-01 ...,   5.60114558e-02
    2.80630003e-01   6.23839900e-03]
 ..., 
 [  6.92285759e-04   5.12035852e-02   1.23511373e-02 ...,   8.16182199e-01
    2.36597366e-02   6.51743452e-02]
 [  2.91487875e-02   1.79304369e-03   1.27613988e-02 ...,   2.01499138e-03
    8.80759116e-01   5.17081916e-02]
 [  3.29964323e-03   6.96633720e-03   1.13673839e-02 ...,   1.23804692e-01
    6.65511952e-02   3.33699995e-01]]
[[  8.34190285e-01   3.95604667e-03   1.29639696e-02 ...,   1.12351445e-04
    1.62279346e-02   2.58110207e-04]
 [  3.21014917e-04   5.69620388e-01   4.56623904e-02 ...,   1.25018267e-03
    2.10683186e-01   7.71346618e-03]
 [  4.04467473e-02   1.03946386e-03   5.14007926e-01 ...,   5.38135346e-02
    2.75042248e-01   5.76748091e-03]
 ..., 
 [  6.33186771e-04   4.89968190e-02   1.18125629e-02 ...,   8.23976127e-01
    2.25853561e-02   6.30526587e-02]
 [  2.83816072e-02   1.63542570e-03   1.21841735e-02 ...,   1.86509991e-03
    8.84791312e-01   5.07037382e-02]
 [  3.19497241e-03   6.75253713e-03   1.08485090e-02 ...,   1.23501702e-01
    6.62674213e-02   3.36102232e-01]]
[[  8.34190285e-01   3.95604667e-03   1.29639696e-02 ...,   1.12351445e-04
    1.62279346e-02   2.58110207e-04]
 [  3.21014917e-04   5.69620388e-01   4.56623904e-02 ...,   1.25018267e-03
    2.10683186e-01   7.71346618e-03]
 [  4.04467473e-02   1.03946386e-03   5.14007926e-01 ...,   5.38135346e-02
    2.75042248e-01   5.76748091e-03]
 ..., 
 [  6.33186771e-04   4.89968190e-02   1.18125629e-02 ...,   8.23976127e-01
    2.25853561e-02   6.30526587e-02]
 [  2.83816072e-02   1.63542570e-03   1.21841735e-02 ...,   1.86509991e-03
    8.84791312e-01   5.07037382e-02]
 [  3.19497241e-03   6.75253713e-03   1.08485090e-02 ...,   1.23501702e-01
    6.62674213e-02   3.36102232e-01]]
[[  8.38368465e-01   3.70570349e-03   1.24633475e-02 ...,   9.91597627e-05
    1.55717248e-02   2.32340210e-04]
 [  2.80292327e-04   5.89589386e-01   4.33134801e-02 ...,   1.10012343e-03
    2.02242435e-01   6.94105978e-03]
 [  3.86804532e-02   9.47650961e-04   5.25088820e-01 ...,   5.16962906e-02
    2.71756429e-01   5.30479063e-03]
 ..., 
 [  5.80557290e-04   4.68032593e-02   1.13019935e-02 ...,   8.31493196e-01
    2.17460250e-02   6.07782488e-02]
 [  2.73733052e-02   1.47651758e-03   1.15216336e-02 ...,   1.71756357e-03
    8.89963960e-01   4.89491479e-02]
 [  3.10032437e-03   6.53984189e-03   1.03665765e-02 ...,   1.23506696e-01
    6.66540307e-02   3.36688865e-01]]
[[  8.38368465e-01   3.70570349e-03   1.24633475e-02 ...,   9.91597627e-05
    1.55717248e-02   2.32340210e-04]
 [  2.80292327e-04   5.89589386e-01   4.33134801e-02 ...,   1.10012343e-03
    2.02242435e-01   6.94105978e-03]
 [  3.86804532e-02   9.47650961e-04   5.25088820e-01 ...,   5.16962906e-02
    2.71756429e-01   5.30479063e-03]
 ..., 
 [  5.80557290e-04   4.68032593e-02   1.13019935e-02 ...,   8.31493196e-01
    2.17460250e-02   6.07782488e-02]
 [  2.73733052e-02   1.47651758e-03   1.15216336e-02 ...,   1.71756357e-03
    8.89963960e-01   4.89491479e-02]
 [  3.10032437e-03   6.53984189e-03   1.03665765e-02 ...,   1.23506696e-01
    6.66540307e-02   3.36688865e-01]]
[[  8.42324984e-01   3.48612454e-03   1.20090090e-02 ...,   8.78641654e-05
    1.48890264e-02   2.10369438e-04]
 [  2.45559203e-04   6.09496802e-01   4.11419677e-02 ...,   9.70619192e-04
    1.93093939e-01   6.27544349e-03]
 [  3.70714407e-02   8.68316666e-04   5.36896446e-01 ...,   4.97063378e-02
    2.67012221e-01   4.90940899e-03]
 ..., 
 [  5.34262327e-04   4.48705634e-02   1.08440333e-02 ...,   8.38214431e-01
    2.09024989e-02   5.88198311e-02]
 [  2.65939783e-02   1.34898503e-03   1.09932103e-02 ...,   1.59538352e-03
    8.93926851e-01   4.77309168e-02]
 [  3.01349702e-03   6.35241763e-03   9.92908931e-03 ...,   1.23438122e-01
    6.67016356e-02   3.38186804e-01]]
[[  8.42324984e-01   3.48612454e-03   1.20090090e-02 ...,   8.78641654e-05
    1.48890264e-02   2.10369438e-04]
 [  2.45559203e-04   6.09496802e-01   4.11419677e-02 ...,   9.70619192e-04
    1.93093939e-01   6.27544349e-03]
 [  3.70714407e-02   8.68316666e-04   5.36896446e-01 ...,   4.97063378e-02
    2.67012221e-01   4.90940899e-03]
 ..., 
 [  5.34262327e-04   4.48705634e-02   1.08440333e-02 ...,   8.38214431e-01
    2.09024989e-02   5.88198311e-02]
 [  2.65939783e-02   1.34898503e-03   1.09932103e-02 ...,   1.59538352e-03
    8.93926851e-01   4.77309168e-02]
 [  3.01349702e-03   6.35241763e-03   9.92908931e-03 ...,   1.23438122e-01
    6.67016356e-02   3.38186804e-01]]
[[  8.45991582e-01   3.28509762e-03   1.15851728e-02 ...,   7.82172662e-05
    1.43012504e-02   1.90955840e-04]
 [  2.15779987e-04   6.27738855e-01   3.90936414e-02 ...,   8.59207026e-04
    1.84860129e-01   5.67844237e-03]
 [  3.55354865e-02   7.96209576e-04   5.47888449e-01 ...,   4.78097757e-02
    2.62797964e-01   4.54407313e-03]
 ..., 
 [  4.92983432e-04   4.30453196e-02   1.04186499e-02 ...,   8.44502645e-01
    2.01609779e-02   5.69210573e-02]
 [  2.57941594e-02   1.23242113e-03   1.04781876e-02 ...,   1.48328920e-03
    8.97937023e-01   4.63836444e-02]
 [  2.93400275e-03   6.17514575e-03   9.52492171e-03 ...,   1.23481134e-01
    6.69305368e-02   3.39190657e-01]]
[[  8.45991582e-01   3.28509762e-03   1.15851728e-02 ...,   7.82172662e-05
    1.43012504e-02   1.90955840e-04]
 [  2.15779987e-04   6.27738855e-01   3.90936414e-02 ...,   8.59207026e-04
    1.84860129e-01   5.67844237e-03]
 [  3.55354865e-02   7.96209576e-04   5.47888449e-01 ...,   4.78097757e-02
    2.62797964e-01   4.54407313e-03]
 ..., 
 [  4.92983432e-04   4.30453196e-02   1.04186499e-02 ...,   8.44502645e-01
    2.01609779e-02   5.69210573e-02]
 [  2.57941594e-02   1.23242113e-03   1.04781876e-02 ...,   1.48328920e-03
    8.97937023e-01   4.63836444e-02]
 [  2.93400275e-03   6.17514575e-03   9.52492171e-03 ...,   1.23481134e-01
    6.69305368e-02   3.39190657e-01]]
[[  8.49442120e-01   3.10428267e-03   1.11935834e-02 ...,   6.98952684e-05
    1.37413168e-02   1.73985535e-04]
 [  1.90168447e-04   6.45191638e-01   3.71779845e-02 ...,   7.62635004e-04
    1.76757971e-01   5.15160831e-03]
 [  3.41000426e-02   7.32084950e-04   5.58847409e-01 ...,   4.60113630e-02
    2.58177111e-01   4.21802869e-03]
 ..., 
 [  4.56203247e-04   4.13751977e-02   1.00288276e-02 ...,   8.50272603e-01
    1.94593783e-02   5.51853124e-02]
 [  2.50855380e-02   1.13220918e-03   1.00243218e-02 ...,   1.38512240e-03
    9.01453469e-01   4.52173123e-02]
 [  2.86075926e-03   6.01286723e-03   9.15307923e-03 ...,   1.23535564e-01
    6.70769076e-02   3.40401484e-01]]
[[  8.49442120e-01   3.10428267e-03   1.11935834e-02 ...,   6.98952684e-05
    1.37413168e-02   1.73985535e-04]
 [  1.90168447e-04   6.45191638e-01   3.71779845e-02 ...,   7.62635004e-04
    1.76757971e-01   5.15160831e-03]
 [  3.41000426e-02   7.32084950e-04   5.58847409e-01 ...,   4.60113630e-02
    2.58177111e-01   4.21802869e-03]
 ..., 
 [  4.56203247e-04   4.13751977e-02   1.00288276e-02 ...,   8.50272603e-01
    1.94593783e-02   5.51853124e-02]
 [  2.50855380e-02   1.13220918e-03   1.00243218e-02 ...,   1.38512240e-03
    9.01453469e-01   4.52173123e-02]
 [  2.86075926e-03   6.01286723e-03   9.15307923e-03 ...,   1.23535564e-01
    6.70769076e-02   3.40401484e-01]]
[[  8.52677362e-01   2.93948992e-03   1.08285681e-02 ...,   6.26946042e-05
    1.32324663e-02   1.58968503e-04]
 [  1.68069283e-04   6.61526900e-01   3.53790836e-02 ...,   6.78824335e-04
    1.69147923e-01   4.68157420e-03]
 [  3.27422613e-02   6.74241478e-04   5.69408219e-01 ...,   4.42996149e-02
    2.53634712e-01   3.92075260e-03]
 ..., 
 [  4.23228113e-04   3.98163759e-02   9.66761095e-03 ...,   8.55639542e-01
    1.88170059e-02   5.35472807e-02]
 [  2.44074669e-02   1.04277731e-03   9.60143244e-03 ...,   1.29648408e-03
    9.04782415e-01   4.40753377e-02]
 [  2.79316726e-03   5.86122335e-03   8.80874738e-03 ...,   1.23641332e-01
    6.72649135e-02   3.41485997e-01]]
[[  8.52677362e-01   2.93948992e-03   1.08285681e-02 ...,   6.26946042e-05
    1.32324663e-02   1.58968503e-04]
 [  1.68069283e-04   6.61526900e-01   3.53790836e-02 ...,   6.78824335e-04
    1.69147923e-01   4.68157420e-03]
 [  3.27422613e-02   6.74241478e-04   5.69408219e-01 ...,   4.42996149e-02
    2.53634712e-01   3.92075260e-03]
 ..., 
 [  4.23228113e-04   3.98163759e-02   9.66761095e-03 ...,   8.55639542e-01
    1.88170059e-02   5.35472807e-02]
 [  2.44074669e-02   1.04277731e-03   9.60143244e-03 ...,   1.29648408e-03
    9.04782415e-01   4.40753377e-02]
 [  2.79316726e-03   5.86122335e-03   8.80874738e-03 ...,   1.23641332e-01
    6.72649135e-02   3.41485997e-01]]
[[  8.55727161e-01   2.78961559e-03   1.04884557e-02 ...,   5.64273863e-05
    1.27577679e-02   1.45672292e-04]
 [  1.48937304e-04   6.76978588e-01   3.36914933e-02 ...,   6.05770463e-04
    1.61857275e-01   4.26295275e-03]
 [  3.14626648e-02   6.22226787e-04   5.79749010e-01 ...,   4.26707545e-02
    2.48983340e-01   3.65127746e-03]
 ..., 
 [  3.93592906e-04   3.83696006e-02   9.33334793e-03 ...,   8.60617222e-01
    1.82171993e-02   5.20207915e-02]
 [  2.37802102e-02   9.63895401e-04   9.21604323e-03 ...,   1.21711261e-03
    9.07832739e-01   4.30183612e-02]
 [  2.73056485e-03   5.72037270e-03   8.48957591e-03 ...,   1.23773405e-01
    6.74348781e-02   3.42599652e-01]]
[[  8.55727161e-01   2.78961559e-03   1.04884557e-02 ...,   5.64273863e-05
    1.27577679e-02   1.45672292e-04]
 [  1.48937304e-04   6.76978588e-01   3.36914933e-02 ...,   6.05770463e-04
    1.61857275e-01   4.26295275e-03]
 [  3.14626648e-02   6.22226787e-04   5.79749010e-01 ...,   4.26707545e-02
    2.48983340e-01   3.65127746e-03]
 ..., 
 [  3.93592906e-04   3.83696006e-02   9.33334793e-03 ...,   8.60617222e-01
    1.82171993e-02   5.20207915e-02]
 [  2.37802102e-02   9.63895401e-04   9.21604323e-03 ...,   1.21711261e-03
    9.07832739e-01   4.30183612e-02]
 [  2.73056485e-03   5.72037270e-03   8.48957591e-03 ...,   1.23773405e-01
    6.74348781e-02   3.42599652e-01]]
[[  8.58604718e-01   2.65262726e-03   1.01703625e-02 ...,   5.09505093e-05
    1.23187807e-02   1.33833637e-04]
 [  1.32324876e-04   6.91526494e-01   3.21065940e-02 ...,   5.41930831e-04
    1.54945284e-01   3.88867321e-03]
 [  3.02527203e-02   5.75229902e-04   5.89799412e-01 ...,   4.11186580e-02
    2.44335033e-01   3.40541703e-03]
 ..., 
 [  3.66856183e-04   3.70185099e-02   9.02268574e-03 ...,   8.65255809e-01
    1.76602114e-02   5.05863751e-02]
 [  2.31888300e-02   8.93524139e-04   8.85957625e-03 ...,   1.14533166e-03
    9.10682769e-01   4.20114115e-02]
 [  2.67244892e-03   5.58870453e-03   8.19274628e-03 ...,   1.23936930e-01
    6.76117408e-02   3.43675243e-01]]
[[  8.58604718e-01   2.65262726e-03   1.01703625e-02 ...,   5.09505093e-05
    1.23187807e-02   1.33833637e-04]
 [  1.32324876e-04   6.91526494e-01   3.21065940e-02 ...,   5.41930831e-04
    1.54945284e-01   3.88867321e-03]
 [  3.02527203e-02   5.75229902e-04   5.89799412e-01 ...,   4.11186580e-02
    2.44335033e-01   3.40541703e-03]
 ..., 
 [  3.66856183e-04   3.70185099e-02   9.02268574e-03 ...,   8.65255809e-01
    1.76602114e-02   5.05863751e-02]
 [  2.31888300e-02   8.93524139e-04   8.85957625e-03 ...,   1.14533166e-03
    9.10682769e-01   4.20114115e-02]
 [  2.67244892e-03   5.58870453e-03   8.19274628e-03 ...,   1.23936930e-01
    6.76117408e-02   3.43675243e-01]]
[[  8.61327193e-01   2.52721341e-03   9.87236768e-03 ...,   4.61430271e-05
    1.19099289e-02   1.23261616e-04]
 [  1.17856673e-04   7.05256971e-01   3.06175567e-02 ...,   4.85963661e-04
    1.48369464e-01   3.55358360e-03]
 [  2.91084140e-02   5.32717486e-04   5.99597620e-01 ...,   3.96387668e-02
    2.39667762e-01   3.18093122e-03]
 ..., 
 [  3.42664286e-04   3.57560158e-02   8.73351947e-03 ...,   8.69583071e-01
    1.71399757e-02   4.92401639e-02]
 [  2.26342840e-02   8.30714649e-04   8.53066783e-03 ...,   1.08034311e-03
    9.13333093e-01   4.10616010e-02]
 [  2.61835500e-03   5.46555864e-03   7.91613781e-03 ...,   1.24124539e-01
    6.77835046e-02   3.44743056e-01]]
[[  8.61327193e-01   2.52721341e-03   9.87236768e-03 ...,   4.61430271e-05
    1.19099289e-02   1.23261616e-04]
 [  1.17856673e-04   7.05256971e-01   3.06175567e-02 ...,   4.85963661e-04
    1.48369464e-01   3.55358360e-03]
 [  2.91084140e-02   5.32717486e-04   5.99597620e-01 ...,   3.96387668e-02
    2.39667762e-01   3.18093122e-03]
 ..., 
 [  3.42664286e-04   3.57560158e-02   8.73351947e-03 ...,   8.69583071e-01
    1.71399757e-02   4.92401639e-02]
 [  2.26342840e-02   8.30714649e-04   8.53066783e-03 ...,   1.08034311e-03
    9.13333093e-01   4.10616010e-02]
 [  2.61835500e-03   5.46555864e-03   7.91613781e-03 ...,   1.24124539e-01
    6.77835046e-02   3.44743056e-01]]
[[  8.63907441e-01   2.41205562e-03   9.59253593e-03 ...,   4.19067610e-05
    1.15291492e-02   1.13785244e-04]
 [  1.05220595e-04   7.18208590e-01   2.92176352e-02 ...,   4.36765230e-04
    1.42127381e-01   3.25288325e-03]
 [  2.80246435e-02   4.94161867e-04   6.09135611e-01 ...,   3.82265435e-02
    2.35012332e-01   2.97535290e-03]
 ..., 
 [  3.20708025e-04   3.45729626e-02   8.46367170e-03 ...,   8.73630081e-01
    1.66537551e-02   4.79731294e-02]
 [  2.21115756e-02   7.74373324e-04   8.22568227e-03 ...,   1.02122982e-03
    9.15811880e-01   4.01594821e-02]
 [  2.56789106e-03   5.35004629e-03   7.65776211e-03 ...,   1.24334705e-01
    6.79541517e-02   3.45792079e-01]]
[[  8.63907441e-01   2.41205562e-03   9.59253593e-03 ...,   4.19067610e-05
    1.15291492e-02   1.13785244e-04]
 [  1.05220595e-04   7.18208590e-01   2.92176352e-02 ...,   4.36765230e-04
    1.42127381e-01   3.25288325e-03]
 [  2.80246435e-02   4.94161867e-04   6.09135611e-01 ...,   3.82265435e-02
    2.35012332e-01   2.97535290e-03]
 ..., 
 [  3.20708025e-04   3.45729626e-02   8.46367170e-03 ...,   8.73630081e-01
    1.66537551e-02   4.79731294e-02]
 [  2.21115756e-02   7.74373324e-04   8.22568227e-03 ...,   1.02122982e-03
    9.15811880e-01   4.01594821e-02]
 [  2.56789106e-03   5.35004629e-03   7.65776211e-03 ...,   1.24334705e-01
    6.79541517e-02   3.45792079e-01]]
[[  8.66357767e-01   2.30607592e-03   9.32925791e-03 ...,   3.81598109e-05
    1.11734973e-02   1.05264570e-04]
 [  9.41543642e-05   7.30435107e-01   2.79006900e-02 ...,   3.93397982e-04
    1.36199816e-01   2.98254369e-03]
 [  2.69973325e-02   4.59128448e-04   6.18423925e-01 ...,   3.68779624e-02
    2.30375324e-01   2.78674161e-03]
 ..., 
 [  3.00725975e-04   3.34624516e-02   8.21136209e-03 ...,   8.77421647e-01
    1.61981148e-02   4.67793691e-02]
 [  2.16186258e-02   7.23691214e-04   7.94243749e-03 ...,   9.67308849e-04
    9.18132658e-01   3.93029573e-02]
 [  2.52070951e-03   5.24150709e-03   7.41592711e-03 ...,   1.24564032e-01
    6.81213552e-02   3.46828006e-01]]
[[  8.66357767e-01   2.30607592e-03   9.32925791e-03 ...,   3.81598109e-05
    1.11734973e-02   1.05264570e-04]
 [  9.41543642e-05   7.30435107e-01   2.79006900e-02 ...,   3.93397982e-04
    1.36199816e-01   2.98254369e-03]
 [  2.69973325e-02   4.59128448e-04   6.18423925e-01 ...,   3.68779624e-02
    2.30375324e-01   2.78674161e-03]
 ..., 
 [  3.00725975e-04   3.34624516e-02   8.21136209e-03 ...,   8.77421647e-01
    1.61981148e-02   4.67793691e-02]
 [  2.16186258e-02   7.23691214e-04   7.94243749e-03 ...,   9.67308849e-04
    9.18132658e-01   3.93029573e-02]
 [  2.52070951e-03   5.24150709e-03   7.41592711e-03 ...,   1.24564032e-01
    6.81213552e-02   3.46828006e-01]]
[[  8.68688757e-01   2.20830743e-03   9.08107219e-03 ...,   3.48341099e-05
    1.08407950e-02   9.75795757e-05]
 [  8.44376202e-05   7.41980502e-01   2.66610013e-02 ...,   3.55072876e-04
    1.30573557e-01   2.73902626e-03]
 [  2.60225649e-02   4.27229670e-04   6.27465686e-01 ...,   3.55892882e-02
    2.25770193e-01   2.61333356e-03]
 ..., 
 [  2.82492356e-04   3.24179501e-02   7.97496990e-03 ...,   8.80980739e-01
    1.57704124e-02   4.56527330e-02]
 [  2.11526873e-02   6.77941450e-04   7.67866290e-03 ...,   9.17962628e-04
    9.20311482e-01   3.84877328e-02]
 [  2.47650711e-03   5.13930975e-03   7.18912159e-03 ...,   1.24810287e-01
    6.82854600e-02   3.47849891e-01]]
[[  8.68688757e-01   2.20830743e-03   9.08107219e-03 ...,   3.48341099e-05
    1.08407950e-02   9.75795757e-05]
 [  8.44376202e-05   7.41980502e-01   2.66610013e-02 ...,   3.55072876e-04
    1.30573557e-01   2.73902626e-03]
 [  2.60225649e-02   4.27229670e-04   6.27465686e-01 ...,   3.55892882e-02
    2.25770193e-01   2.61333356e-03]
 ..., 
 [  2.82492356e-04   3.24179501e-02   7.97496990e-03 ...,   8.80980739e-01
    1.57704124e-02   4.56527330e-02]
 [  2.11526873e-02   6.77941450e-04   7.67866290e-03 ...,   9.17962628e-04
    9.20311482e-01   3.84877328e-02]
 [  2.47650711e-03   5.13930975e-03   7.18912159e-03 ...,   1.24810287e-01
    6.82854600e-02   3.47849891e-01]]
[[  8.70909978e-01   2.11791337e-03   8.84669500e-03 ...,   3.18725609e-05
    1.05289514e-02   9.06286335e-05]
 [  7.58842636e-05   7.52888477e-01   2.54932829e-02 ...,   3.21119733e-04
    1.25233201e-01   2.51926911e-03]
 [  2.50968400e-02   3.98129898e-04   6.36266731e-01 ...,   3.43570976e-02
    2.21205589e-01   2.45361142e-03]
 ..., 
 [  2.65812744e-04   3.14338296e-02   7.75307960e-03 ...,   8.84327396e-01
    1.53681612e-02   4.45879892e-02]
 [  2.07116510e-02   6.36520445e-04   7.43250887e-03 ...,   8.72675009e-04
    9.22360891e-01   3.77108742e-02]
 [  2.43501580e-03   5.04291159e-03   6.97601630e-03 ...,   1.25071181e-01
    6.84459403e-02   3.48859219e-01]]
[[  8.70909978e-01   2.11791337e-03   8.84669500e-03 ...,   3.18725609e-05
    1.05289514e-02   9.06286335e-05]
 [  7.58842636e-05   7.52888477e-01   2.54932829e-02 ...,   3.21119733e-04
    1.25233201e-01   2.51926911e-03]
 [  2.50968400e-02   3.98129898e-04   6.36266731e-01 ...,   3.43570976e-02
    2.21205589e-01   2.45361142e-03]
 ..., 
 [  2.65812744e-04   3.14338296e-02   7.75307960e-03 ...,   8.84327396e-01
    1.53681612e-02   4.45879892e-02]
 [  2.07116510e-02   6.36520445e-04   7.43250887e-03 ...,   8.72675009e-04
    9.22360891e-01   3.77108742e-02]
 [  2.43501580e-03   5.04291159e-03   6.97601630e-03 ...,   1.25071181e-01
    6.84459403e-02   3.48859219e-01]]
[[  8.73029942e-01   2.03415621e-03   8.62497832e-03 ...,   2.92271045e-05
    1.02361612e-02   8.43246716e-05]
 [  6.83367465e-05   7.63199082e-01   2.43926437e-02 ...,   2.90968739e-04
    1.20164406e-01   2.32059923e-03]
 [  2.42169324e-02   3.71534110e-04   6.44831870e-01 ...,   3.31782313e-02
    2.16689945e-01   2.30623425e-03]
 ..., 
 [  2.50518560e-04   3.05050282e-02   7.54442780e-03 ...,   8.87479606e-01
    1.49892018e-02   4.35803051e-02]
 [  2.02935122e-02   5.98907459e-04   7.20230331e-03 ...,   8.30997349e-04
    9.24292493e-01   3.69694289e-02]
 [  2.39599865e-03   4.95182335e-03   6.77542889e-03 ...,   1.25344774e-01
    6.86027052e-02   3.49856516e-01]]
[[  8.73029942e-01   2.03415621e-03   8.62497832e-03 ...,   2.92271045e-05
    1.02361612e-02   8.43246716e-05]
 [  6.83367465e-05   7.63199082e-01   2.43926437e-02 ...,   2.90968739e-04
    1.20164406e-01   2.32059923e-03]
 [  2.42169324e-02   3.71534110e-04   6.44831870e-01 ...,   3.31782313e-02
    2.16689945e-01   2.30623425e-03]
 ..., 
 [  2.50518560e-04   3.05050282e-02   7.54442780e-03 ...,   8.87479606e-01
    1.49892018e-02   4.35803051e-02]
 [  2.02935122e-02   5.98907459e-04   7.20230331e-03 ...,   8.30997349e-04
    9.24292493e-01   3.69694289e-02]
 [  2.39599865e-03   4.95182335e-03   6.77542889e-03 ...,   1.25344774e-01
    6.86027052e-02   3.49856516e-01]]
[[  8.75056300e-01   1.95638816e-03   8.41489853e-03 ...,   2.68570702e-05
    9.96079448e-03   7.85929708e-05]
 [  6.16612253e-05   7.72950046e-01   2.33545591e-02 ...,   2.64133358e-04
    1.15352949e-01   2.14068354e-03]
 [  2.33798946e-02   3.47183585e-04   6.53166255e-01 ...,   3.20497701e-02
    2.12230056e-01   2.17002329e-03]
 ..., 
 [  2.36463249e-04   2.96270500e-02   7.34789167e-03 ...,   8.90453396e-01
    1.46315908e-02   4.26253476e-02]
 [  1.98965172e-02   5.64657512e-04   6.98658947e-03 ...,   7.92543373e-04
    9.26116371e-01   3.62608556e-02]
 [  2.35924514e-03   4.86561045e-03   6.58630745e-03 ...,   1.25629296e-01
    6.87556016e-02   3.50842581e-01]]
[[  8.75056300e-01   1.95638816e-03   8.41489853e-03 ...,   2.68570702e-05
    9.96079448e-03   7.85929708e-05]
 [  6.16612253e-05   7.72950046e-01   2.33545591e-02 ...,   2.64133358e-04
    1.15352949e-01   2.14068354e-03]
 [  2.33798946e-02   3.47183585e-04   6.53166255e-01 ...,   3.20497701e-02
    2.12230056e-01   2.17002329e-03]
 ..., 
 [  2.36463249e-04   2.96270500e-02   7.34789167e-03 ...,   8.90453396e-01
    1.46315908e-02   4.26253476e-02]
 [  1.98965172e-02   5.64657512e-04   6.98658947e-03 ...,   7.92543373e-04
    9.26116371e-01   3.62608556e-02]
 [  2.35924514e-03   4.86561045e-03   6.58630745e-03 ...,   1.25629296e-01
    6.87556016e-02   3.50842581e-01]]
[[  8.76995927e-01   1.88403741e-03   8.21553837e-03 ...,   2.47278939e-05
    9.70139932e-03   7.33690787e-05]
 [  5.57436645e-05   7.82176504e-01   2.23748441e-02 ...,   2.40197004e-04
    1.10785172e-01   1.97747939e-03]
 [  2.25830181e-02   3.24850500e-04   6.61274923e-01 ...,   3.09690095e-02
    2.07831766e-01   2.04393553e-03]
 ..., 
 [  2.23518895e-04   2.87958655e-02   7.16246759e-03 ...,   8.93263139e-01
    1.42935963e-02   4.17191788e-02]
 [  1.95190760e-02   5.33386904e-04   6.78407386e-03 ...,   7.56977311e-04
    9.27841537e-01   3.55828267e-02]
 [  2.32456773e-03   4.78388314e-03   6.40771214e-03 ...,   1.25923173e-01
    6.89045704e-02   3.51818062e-01]]
[[  8.76995927e-01   1.88403741e-03   8.21553837e-03 ...,   2.47278939e-05
    9.70139932e-03   7.33690787e-05]
 [  5.57436645e-05   7.82176504e-01   2.23748441e-02 ...,   2.40197004e-04
    1.10785172e-01   1.97747939e-03]
 [  2.25830181e-02   3.24850500e-04   6.61274923e-01 ...,   3.09690095e-02
    2.07831766e-01   2.04393553e-03]
 ..., 
 [  2.23518895e-04   2.87958655e-02   7.16246759e-03 ...,   8.93263139e-01
    1.42935963e-02   4.17191788e-02]
 [  1.95190760e-02   5.33386904e-04   6.78407386e-03 ...,   7.56977311e-04
    9.27841537e-01   3.55828267e-02]
 [  2.32456773e-03   4.78388314e-03   6.40771214e-03 ...,   1.25923173e-01
    6.89045704e-02   3.51818062e-01]]
[[  8.78855025e-01   1.81659837e-03   8.02607439e-03 ...,   2.28100725e-05
    9.45667195e-03   6.85972011e-05]
 [  5.04866144e-05   7.90911269e-01   2.14496259e-02 ...,   2.18801857e-04
    1.06447926e-01   1.82919503e-03]
 [  2.18238119e-02   3.04333899e-04   6.69162957e-01 ...,   2.99334386e-02
    2.03499909e-01   1.92704620e-03]
 ..., 
 [  2.11573483e-04   2.80078607e-02   6.98725696e-03 ...,   8.95921744e-01
    1.39736632e-02   4.08582288e-02]
 [  1.91597605e-02   5.04764186e-04   6.59361080e-03 ...,   7.24006714e-04
    9.29476000e-01   3.49332510e-02]
 [  2.29179876e-03   4.70629187e-03   6.23880121e-03 ...,   1.26224990e-01
    6.90495787e-02   3.52783602e-01]]
[[  8.78855025e-01   1.81659837e-03   8.02607439e-03 ...,   2.28100725e-05
    9.45667195e-03   6.85972011e-05]
 [  5.04866144e-05   7.90911269e-01   2.14496259e-02 ...,   2.18801857e-04
    1.06447926e-01   1.82919503e-03]
 [  2.18238119e-02   3.04333899e-04   6.69162957e-01 ...,   2.99334386e-02
    2.03499909e-01   1.92704620e-03]
 ..., 
 [  2.11573483e-04   2.80078607e-02   6.98725696e-03 ...,   8.95921744e-01
    1.39736632e-02   4.08582288e-02]
 [  1.91597605e-02   5.04764186e-04   6.59361080e-03 ...,   7.24006714e-04
    9.29476000e-01   3.49332510e-02]
 [  2.29179876e-03   4.70629187e-03   6.23880121e-03 ...,   1.26224990e-01
    6.90495787e-02   3.52783602e-01]]
[[  8.80639199e-01   1.75362273e-03   7.84576523e-03 ...,   2.10783219e-05
    9.22544126e-03   6.42288524e-05]
 [  4.58065648e-05   7.99184935e-01   2.05753199e-02 ...,   1.99639688e-04
    1.02328639e-01   1.69425534e-03]
 [  2.10999804e-02   2.85456082e-04   6.76835430e-01 ...,   2.89407210e-02
    1.99238485e-01   1.81853256e-03]
 ..., 
 [  2.00528603e-04   2.72597823e-02   6.82145277e-03 ...,   8.98440836e-01
    1.36703941e-02   4.00392510e-02]
 [  1.88172790e-02   4.78501834e-04   6.41418026e-03 ...,   6.93375714e-04
    9.31026924e-01   3.43102299e-02]
 [  2.26078790e-03   4.63252203e-03   6.07881857e-03 ...,   1.26533479e-01
    6.91906307e-02   3.53739793e-01]]
[[  8.80639199e-01   1.75362273e-03   7.84576523e-03 ...,   2.10783219e-05
    9.22544126e-03   6.42288524e-05]
 [  4.58065648e-05   7.99184935e-01   2.05753199e-02 ...,   1.99639688e-04
    1.02328639e-01   1.69425534e-03]
 [  2.10999804e-02   2.85456082e-04   6.76835430e-01 ...,   2.89407210e-02
    1.99238485e-01   1.81853256e-03]
 ..., 
 [  2.00528603e-04   2.72597823e-02   6.82145277e-03 ...,   8.98440836e-01
    1.36703941e-02   4.00392510e-02]
 [  1.88172790e-02   4.78501834e-04   6.41418026e-03 ...,   6.93375714e-04
    9.31026924e-01   3.43102299e-02]
 [  2.26078790e-03   4.63252203e-03   6.07881857e-03 ...,   1.26533479e-01
    6.91906307e-02   3.53739793e-01]]
[[  8.82353530e-01   1.69471203e-03   7.67394191e-03 ...,   1.95108902e-05
    9.00665229e-03   6.02217502e-05]
 [  4.16317547e-05   8.07026036e-01   1.97486061e-02 ...,   1.82444244e-04
    9.84153214e-02   1.57127280e-03]
 [  2.04094043e-02   2.68059571e-04   6.84297422e-01 ...,   2.79886780e-02
    1.95050735e-01   1.71766070e-03]
 ..., 
 [  1.90297533e-04   2.65486953e-02   6.66432858e-03 ...,   9.00830907e-01
    1.33825296e-02   3.92592891e-02]
 [  1.84904618e-02   4.54349630e-04   6.24487199e-03 ...,   6.64859696e-04
    9.32500729e-01   3.37120399e-02]
 [  2.23140000e-03   4.56228986e-03   5.92708331e-03 ...,   1.26847503e-01
    6.93277545e-02   3.54687196e-01]]
[[  8.82353530e-01   1.69471203e-03   7.67394191e-03 ...,   1.95108902e-05
    9.00665229e-03   6.02217502e-05]
 [  4.16317547e-05   8.07026036e-01   1.97486061e-02 ...,   1.82444244e-04
    9.84153214e-02   1.57127280e-03]
 [  2.04094043e-02   2.68059571e-04   6.84297422e-01 ...,   2.79886780e-02
    1.95050735e-01   1.71766070e-03]
 ..., 
 [  1.90297533e-04   2.65486953e-02   6.66432858e-03 ...,   9.00830907e-01
    1.33825296e-02   3.92592891e-02]
 [  1.84904618e-02   4.54349630e-04   6.24487199e-03 ...,   6.64859696e-04
    9.32500729e-01   3.37120399e-02]
 [  2.23140000e-03   4.56228986e-03   5.92708331e-03 ...,   1.26847503e-01
    6.93277545e-02   3.54687196e-01]]
[[  8.84002632e-01   1.63951123e-03   7.50999925e-03 ...,   1.80889954e-05
    8.79935288e-03   5.65388971e-05]
 [  3.79003568e-05   8.14461172e-01   1.89664085e-02 ...,   1.66984913e-04
    9.46965770e-02   1.45902268e-03]
 [  1.97501237e-02   2.52004505e-04   6.91554004e-01 ...,   2.70752743e-02
    1.90939239e-01   1.62377412e-03]
 ..., 
 [  1.80803622e-04   2.58719441e-02   6.51522884e-03 ...,   9.03101451e-01
    1.31089316e-02   3.85156467e-02]
 [  1.81782465e-02   4.32089094e-04   6.08487121e-03 ...,   6.38260787e-04
    9.33903185e-01   3.31371109e-02]
 [  2.20351321e-03   4.49533879e-03   5.78298073e-03 ...,   1.27166037e-01
    6.94609986e-02   3.55626337e-01]]
[[  8.84002632e-01   1.63951123e-03   7.50999925e-03 ...,   1.80889954e-05
    8.79935288e-03   5.65388971e-05]
 [  3.79003568e-05   8.14461172e-01   1.89664085e-02 ...,   1.66984913e-04
    9.46965770e-02   1.45902268e-03]
 [  1.97501237e-02   2.52004505e-04   6.91554004e-01 ...,   2.70752743e-02
    1.90939239e-01   1.62377412e-03]
 ..., 
 [  1.80803622e-04   2.58719441e-02   6.51522884e-03 ...,   9.03101451e-01
    1.31089316e-02   3.85156467e-02]
 [  1.81782465e-02   4.32089094e-04   6.08487121e-03 ...,   6.38260787e-04
    9.33903185e-01   3.31371109e-02]
 [  2.20351321e-03   4.49533879e-03   5.78298073e-03 ...,   1.27166037e-01
    6.94609986e-02   3.55626337e-01]]
[[  8.85590707e-01   1.58770328e-03   7.35338860e-03 ...,   1.67963635e-05
    8.60268190e-03   5.31478162e-05]
 [  3.45589668e-05   8.21515147e-01   1.82258754e-02 ...,   1.53061436e-04
    9.11615944e-02   1.35642185e-03]
 [  1.91203234e-02   2.37166404e-04   6.98610237e-01 ...,   2.61986052e-02
    1.86905993e-01   1.53628409e-03]
 ..., 
 [  1.71978934e-04   2.52271209e-02   6.37356070e-03 ...,   9.05261073e-01
    1.28485699e-02   3.78058603e-02]
 [  1.78796661e-02   4.11528860e-04   5.93344669e-03 ...,   6.13404110e-04
    9.35239495e-01   3.25840097e-02]
 [  2.17701737e-03   4.43143632e-03   5.64595459e-03 ...,   1.27488162e-01
    6.95904265e-02   3.56557713e-01]]
[[  8.85590707e-01   1.58770328e-03   7.35338860e-03 ...,   1.67963635e-05
    8.60268190e-03   5.31478162e-05]
 [  3.45589668e-05   8.21515147e-01   1.82258754e-02 ...,   1.53061436e-04
    9.11615944e-02   1.35642185e-03]
 [  1.91203234e-02   2.37166404e-04   6.98610237e-01 ...,   2.61986052e-02
    1.86905993e-01   1.53628409e-03]
 ..., 
 [  1.71978934e-04   2.52271209e-02   6.37356070e-03 ...,   9.05261073e-01
    1.28485699e-02   3.78058603e-02]
 [  1.78796661e-02   4.11528860e-04   5.93344669e-03 ...,   6.13404110e-04
    9.35239495e-01   3.25840097e-02]
 [  2.17701737e-03   4.43143632e-03   5.64595459e-03 ...,   1.27488162e-01
    6.95904265e-02   3.56557713e-01]]
[[  8.87121586e-01   1.53900437e-03   7.20361145e-03 ...,   1.56188469e-05
    8.41585896e-03   5.00199114e-05]
 [  3.15613425e-05   8.28211092e-01   1.75243615e-02 ...,   1.40499484e-04
    8.78001377e-02   1.26251062e-03]
 [  1.85183196e-02   2.23434250e-04   7.05471160e-01 ...,   2.53568848e-02
    1.82952478e-01   1.45466138e-03]
 ..., 
 [  1.63763092e-04   2.46120368e-02   6.23878677e-03 ...,   9.07317595e-01
    1.26005094e-02   3.71276759e-02]
 [  1.75938383e-02   3.92500801e-04   5.78994042e-03 ...,   5.90134622e-04
    9.36514361e-01   3.20514250e-02]
 [  2.15181270e-03   4.37037132e-03   5.51550041e-03 ...,   1.27813050e-01
    6.97161138e-02   3.57481788e-01]]
[[  8.87121586e-01   1.53900437e-03   7.20361145e-03 ...,   1.56188469e-05
    8.41585896e-03   5.00199114e-05]
 [  3.15613425e-05   8.28211092e-01   1.75243615e-02 ...,   1.40499484e-04
    8.78001377e-02   1.26251062e-03]
 [  1.85183196e-02   2.23434250e-04   7.05471160e-01 ...,   2.53568848e-02
    1.82952478e-01   1.45466138e-03]
 ..., 
 [  1.63763092e-04   2.46120368e-02   6.23878677e-03 ...,   9.07317595e-01
    1.26005094e-02   3.71276759e-02]
 [  1.75938383e-02   3.92500801e-04   5.78994042e-03 ...,   5.90134622e-04
    9.36514361e-01   3.20514250e-02]
 [  2.15181270e-03   4.37037132e-03   5.51550041e-03 ...,   1.27813050e-01
    6.97161138e-02   3.57481788e-01]]
[[  8.88598772e-01   1.49315988e-03   7.06021389e-03 ...,   1.45441075e-05
    8.23817556e-03   4.71299301e-05]
 [  2.88673483e-05   8.34570579e-01   1.68594118e-02 ...,   1.29146935e-04
    8.46025296e-02   1.17643707e-03]
 [  1.79425482e-02   2.10708832e-04   7.12141783e-01 ...,   2.45484365e-02
    1.79079726e-01   1.37842916e-03]
 ..., 
 [  1.56102303e-04   2.40246980e-02   6.11041899e-03 ...,   9.09278134e-01
    1.23639000e-02   3.64790279e-02]
 [  1.73199563e-02   3.74856782e-04   5.65375885e-03 ...,   5.68314458e-04
    9.37732044e-01   3.15381539e-02]
 [  2.12780856e-03   4.31195161e-03   5.39115967e-03 ...,   1.28139955e-01
    6.98381443e-02   3.58399000e-01]]
[[  8.88598772e-01   1.49315988e-03   7.06021389e-03 ...,   1.45441075e-05
    8.23817556e-03   4.71299301e-05]
 [  2.88673483e-05   8.34570579e-01   1.68594118e-02 ...,   1.29146935e-04
    8.46025296e-02   1.17643707e-03]
 [  1.79425482e-02   2.10708832e-04   7.12141783e-01 ...,   2.45484365e-02
    1.79079726e-01   1.37842916e-03]
 ..., 
 [  1.56102303e-04   2.40246980e-02   6.11041899e-03 ...,   9.09278134e-01
    1.23639000e-02   3.64790279e-02]
 [  1.73199563e-02   3.74856782e-04   5.65375885e-03 ...,   5.68314458e-04
    9.37732044e-01   3.15381539e-02]
 [  2.12780856e-03   4.31195161e-03   5.39115967e-03 ...,   1.28139955e-01
    6.98381443e-02   3.58399000e-01]]
[[  8.90025476e-01   1.44994090e-03   6.92278177e-03 ...,   1.35613526e-05
    8.06898722e-03   4.44555105e-05]
 [  2.64420684e-05   8.40613735e-01   1.62287461e-02 ...,   1.18870743e-04
    8.15596321e-02   1.09744363e-03]
 [  1.73915542e-02   1.98901316e-04   7.18627077e-01 ...,   2.37716834e-02
    1.75288373e-01   1.30715685e-03]
 ..., 
 [  1.48948518e-04   2.34632842e-02   5.98801314e-03 ...,   9.11149184e-01
    1.21379668e-02   3.58580205e-02]
 [  1.70572812e-02   3.58465912e-04   5.52436529e-03 ...,   5.47820681e-04
    9.38896413e-01   3.10430912e-02]
 [  2.10492247e-03   4.25600198e-03   5.27251476e-03 ...,   1.28468207e-01
    6.99566084e-02   3.59309760e-01]]
[[  8.90025476e-01   1.44994090e-03   6.92278177e-03 ...,   1.35613526e-05
    8.06898722e-03   4.44555105e-05]
 [  2.64420684e-05   8.40613735e-01   1.62287461e-02 ...,   1.18870743e-04
    8.15596321e-02   1.09744363e-03]
 [  1.73915542e-02   1.98901316e-04   7.18627077e-01 ...,   2.37716834e-02
    1.75288373e-01   1.30715685e-03]
 ..., 
 [  1.48948518e-04   2.34632842e-02   5.98801314e-03 ...,   9.11149184e-01
    1.21379668e-02   3.58580205e-02]
 [  1.70572812e-02   3.58465912e-04   5.52436529e-03 ...,   5.47820681e-04
    9.38896413e-01   3.10430912e-02]
 [  2.10492247e-03   4.25600198e-03   5.27251476e-03 ...,   1.28468207e-01
    6.99566084e-02   3.59309760e-01]]
[[  8.91404642e-01   1.40914121e-03   6.79093647e-03 ...,   1.26611142e-05
    7.90770669e-03   4.19767978e-05]
 [  2.42550611e-05   8.46359341e-01   1.56302459e-02 ...,   1.09554285e-04
    7.86628255e-02   1.02485547e-03]
 [  1.68639824e-02   1.87932013e-04   7.24931967e-01 ...,   2.30251410e-02
    1.71578713e-01   1.24045489e-03]
 ..., 
 [  1.42258720e-04   2.29261303e-02   5.87116418e-03 ...,   9.12936679e-01
    1.19220026e-02   3.52629113e-02]
 [  1.68051343e-02   3.43212228e-04   5.40127336e-03 ...,   5.28543364e-04
    9.40010993e-01   3.05652187e-02]
 [  2.08307917e-03   4.20236231e-03   5.15918462e-03 ...,   1.28797201e-01
    7.00716004e-02   3.60214454e-01]]
[[  8.91404642e-01   1.40914121e-03   6.79093647e-03 ...,   1.26611142e-05
    7.90770669e-03   4.19767978e-05]
 [  2.42550611e-05   8.46359341e-01   1.56302459e-02 ...,   1.09554285e-04
    7.86628255e-02   1.02485547e-03]
 [  1.68639824e-02   1.87932013e-04   7.24931967e-01 ...,   2.30251410e-02
    1.71578713e-01   1.24045489e-03]
 ..., 
 [  1.42258720e-04   2.29261303e-02   5.87116418e-03 ...,   9.12936679e-01
    1.19220026e-02   3.52629113e-02]
 [  1.68051343e-02   3.43212228e-04   5.40127336e-03 ...,   5.28543364e-04
    9.40010993e-01   3.05652187e-02]
 [  2.08307917e-03   4.20236231e-03   5.15918462e-03 ...,   1.28797201e-01
    7.00716004e-02   3.60214454e-01]]
[[  8.92738977e-01   1.37057462e-03   6.66433120e-03 ...,   1.18350631e-05
    7.75379794e-03   3.96761184e-05]
 [  2.22797280e-05   8.51824929e-01   1.50619413e-02 ...,   1.01095121e-04
    7.59039847e-02   9.58070437e-04]
 [  1.63585690e-02   1.77729306e-04   7.31061323e-01 ...,   2.23074098e-02
    1.67950739e-01   1.17797007e-03]
 ..., 
 [  1.35994308e-04   2.24117105e-02   5.75950209e-03 ...,   9.14646050e-01
    1.17153601e-02   3.46920968e-02]
 [  1.65628915e-02   3.28992724e-04   5.28404128e-03 ...,   5.10383959e-04
    9.41078997e-01   3.01035971e-02]
 [  2.06220990e-03   4.15088602e-03   5.05082081e-03 ...,   1.29126393e-01
    7.01832175e-02   3.61113445e-01]]
[[  8.92738977e-01   1.37057462e-03   6.66433120e-03 ...,   1.18350631e-05
    7.75379794e-03   3.96761184e-05]
 [  2.22797280e-05   8.51824929e-01   1.50619413e-02 ...,   1.01095121e-04
    7.59039847e-02   9.58070437e-04]
 [  1.63585690e-02   1.77729306e-04   7.31061323e-01 ...,   2.23074098e-02
    1.67950739e-01   1.17797007e-03]
 ..., 
 [  1.35994308e-04   2.24117105e-02   5.75950209e-03 ...,   9.14646050e-01
    1.17153601e-02   3.46920968e-02]
 [  1.65628915e-02   3.28992724e-04   5.28404128e-03 ...,   5.10383959e-04
    9.41078997e-01   3.01035971e-02]
 [  2.06220990e-03   4.15088602e-03   5.05082081e-03 ...,   1.29126393e-01
    7.01832175e-02   3.61113445e-01]]
[[  8.94030976e-01   1.33407271e-03   6.54264775e-03 ...,   1.10758531e-05
    7.60677086e-03   3.75377018e-05]
 [  2.04927809e-05   8.57026870e-01   1.45219997e-02 ...,   9.34030764e-05
    7.32754564e-02   8.96550389e-04]
 [  1.58741341e-02   1.68228713e-04   7.37019953e-01 ...,   2.16171689e-02
    1.64404182e-01   1.11938162e-03]
 ..., 
 [  1.30120570e-04   2.19186234e-02   5.65268825e-03 ...,   9.16282279e-01
    1.15174466e-02   3.41440990e-02]
 [  1.63299777e-02   3.15715679e-04   5.17226701e-03 ...,   4.93253900e-04
    9.42103367e-01   2.96573579e-02]
 [  2.04225169e-03   4.10143870e-03   4.94710421e-03 ...,   1.29455291e-01
    7.02915578e-02   3.62007073e-01]]
[[  8.94030976e-01   1.33407271e-03   6.54264775e-03 ...,   1.10758531e-05
    7.60677086e-03   3.75377018e-05]
 [  2.04927809e-05   8.57026870e-01   1.45219997e-02 ...,   9.34030764e-05
    7.32754564e-02   8.96550389e-04]
 [  1.58741341e-02   1.68228713e-04   7.37019953e-01 ...,   2.16171689e-02
    1.64404182e-01   1.11938162e-03]
 ..., 
 [  1.30120570e-04   2.19186234e-02   5.65268825e-03 ...,   9.16282279e-01
    1.15174466e-02   3.41440990e-02]
 [  1.63299777e-02   3.15715679e-04   5.17226701e-03 ...,   4.93253900e-04
    9.42103367e-01   2.96573579e-02]
 [  2.04225169e-03   4.10143870e-03   4.94710421e-03 ...,   1.29455291e-01
    7.02915578e-02   3.62007073e-01]]
[[  8.95282941e-01   1.29948284e-03   6.42559357e-03 ...,   1.03769878e-05
    7.46617662e-03   3.55474432e-05]
 [  1.88737884e-05   8.61980458e-01   1.40087152e-02 ...,   8.63986237e-05
    7.07700346e-02   8.39813599e-04]
 [  1.54095749e-02   1.59372085e-04   7.42812596e-01 ...,   2.09531702e-02
    1.60938552e-01   1.06439763e-03]
 ..., 
 [  1.24606227e-04   2.14455801e-02   5.55041224e-03 ...,   9.17849940e-01
    1.13277177e-02   3.36175540e-02]
 [  1.61058621e-02   3.03299218e-04   5.06558388e-03 ...,   4.77073401e-04
    9.43086794e-01   2.92256965e-02]
 [  2.02314678e-03   4.05389684e-03   4.84774201e-03 ...,   1.29783456e-01
    7.03967200e-02   3.62895658e-01]]
[[  8.95282941e-01   1.29948284e-03   6.42559357e-03 ...,   1.03769878e-05
    7.46617662e-03   3.55474432e-05]
 [  1.88737884e-05   8.61980458e-01   1.40087152e-02 ...,   8.63986237e-05
    7.07700346e-02   8.39813599e-04]
 [  1.54095749e-02   1.59372085e-04   7.42812596e-01 ...,   2.09531702e-02
    1.60938552e-01   1.06439763e-03]
 ..., 
 [  1.24606227e-04   2.14455801e-02   5.55041224e-03 ...,   9.17849940e-01
    1.13277177e-02   3.36175540e-02]
 [  1.61058621e-02   3.03299218e-04   5.06558388e-03 ...,   4.77073401e-04
    9.43086794e-01   2.92256965e-02]
 [  2.02314678e-03   4.05389684e-03   4.84774201e-03 ...,   1.29783456e-01
    7.03967200e-02   3.62895658e-01]]
[[  8.96496997e-01   1.26666640e-03   6.31289929e-03 ...,   9.73270882e-06
    7.33160352e-03   3.36926992e-05]
 [  1.74047904e-05   8.66699982e-01   1.35204991e-02 ...,   8.00114851e-05
    6.83809379e-02   7.87428198e-04]
 [  1.49638595e-02   1.51106889e-04   7.48443919e-01 ...,   2.03142337e-02
    1.57553162e-01   1.01275210e-03]
 ..., 
 [  1.19423031e-04   2.09913930e-02   5.45238902e-03 ...,   9.19353244e-01
    1.11456730e-02   3.31112013e-02]
 [  1.58900538e-02   2.91670092e-04   4.96365686e-03 ...,   4.61770421e-04
    9.44031752e-01   2.88078666e-02]
 [  2.00484208e-03   4.00814680e-03   4.75246509e-03 ...,   1.30110488e-01
    7.04988021e-02   3.63779500e-01]]
[[  8.96496997e-01   1.26666640e-03   6.31289929e-03 ...,   9.73270882e-06
    7.33160352e-03   3.36926992e-05]
 [  1.74047904e-05   8.66699982e-01   1.35204991e-02 ...,   8.00114851e-05
    6.83809379e-02   7.87428198e-04]
 [  1.49638595e-02   1.51106889e-04   7.48443919e-01 ...,   2.03142337e-02
    1.57553162e-01   1.01275210e-03]
 ..., 
 [  1.19423031e-04   2.09913930e-02   5.45238902e-03 ...,   9.19353244e-01
    1.11456730e-02   3.31112013e-02]
 [  1.58900538e-02   2.91670092e-04   4.96365686e-03 ...,   4.61770421e-04
    9.44031752e-01   2.88078666e-02]
 [  2.00484208e-03   4.00814680e-03   4.75246509e-03 ...,   1.30110488e-01
    7.04988021e-02   3.63779500e-01]]
[[  8.97675113e-01   1.23549733e-03   6.20431645e-03 ...,   9.13789995e-06
    7.20267337e-03   3.19621121e-05]
 [  1.60699698e-05   8.71198803e-01   1.30558706e-02 ...,   7.41794440e-05
    6.61017855e-02   7.39006432e-04]
 [  1.45360213e-02   1.43385594e-04   7.53918505e-01 ...,   1.96992422e-02
    1.54247162e-01   9.64202164e-04]
 ..., 
 [  1.14545429e-04   2.05549662e-02   5.35835643e-03 ...,   9.20796068e-01
    1.09708515e-02   3.26238747e-02]
 [  1.56820982e-02   2.80762618e-04   4.86617925e-03 ...,   4.47279771e-04
    9.44940515e-01   2.84031745e-02]
 [  1.98728870e-03   3.96408381e-03   4.66102572e-03 ...,   1.30436029e-01
    7.05979008e-02   3.64658881e-01]]
[[  8.97675113e-01   1.23549733e-03   6.20431645e-03 ...,   9.13789995e-06
    7.20267337e-03   3.19621121e-05]
 [  1.60699698e-05   8.71198803e-01   1.30558706e-02 ...,   7.41794440e-05
    6.61017855e-02   7.39006432e-04]
 [  1.45360213e-02   1.43385594e-04   7.53918505e-01 ...,   1.96992422e-02
    1.54247162e-01   9.64202164e-04]
 ..., 
 [  1.14545429e-04   2.05549662e-02   5.35835643e-03 ...,   9.20796068e-01
    1.09708515e-02   3.26238747e-02]
 [  1.56820982e-02   2.80762618e-04   4.86617925e-03 ...,   4.47279771e-04
    9.44940515e-01   2.84031745e-02]
 [  1.98728870e-03   3.96408381e-03   4.66102572e-03 ...,   1.30436029e-01
    7.05979008e-02   3.64658881e-01]]
[[  8.98819116e-01   1.20586072e-03   6.09961548e-03 ...,   8.58800516e-06
    7.07903824e-03   3.03454585e-05]
 [  1.48553705e-05   8.75489415e-01   1.26134493e-02 ...,   6.88473203e-05
    6.39265752e-02   6.94199655e-04]
 [  1.41251544e-02   1.36165124e-04   7.59240856e-01 ...,   1.91071374e-02
    1.51019559e-01   9.18525800e-04]
 ..., 
 [  1.09950260e-04   2.01352863e-02   5.26807302e-03 ...,   9.22181992e-01
    1.08028280e-02   3.21544940e-02]
 [  1.54815738e-02   2.70517773e-04   4.77286980e-03 ...,   4.33542336e-04
    9.45815178e-01   2.80109745e-02]
 [  1.97044159e-03   3.92161115e-03   4.57319549e-03 ...,   1.30759758e-01
    7.06941111e-02   3.65534065e-01]]
[[  8.98819116e-01   1.20586072e-03   6.09961548e-03 ...,   8.58800516e-06
    7.07903824e-03   3.03454585e-05]
 [  1.48553705e-05   8.75489415e-01   1.26134493e-02 ...,   6.88473203e-05
    6.39265752e-02   6.94199655e-04]
 [  1.41251544e-02   1.36165124e-04   7.59240856e-01 ...,   1.91071374e-02
    1.51019559e-01   9.18525800e-04]
 ..., 
 [  1.09950260e-04   2.01352863e-02   5.26807302e-03 ...,   9.22181992e-01
    1.08028280e-02   3.21544940e-02]
 [  1.54815738e-02   2.70517773e-04   4.77286980e-03 ...,   4.33542336e-04
    9.45815178e-01   2.80109745e-02]
 [  1.97044159e-03   3.92161115e-03   4.57319549e-03 ...,   1.30759758e-01
    7.06941111e-02   3.65534065e-01]]
[[  8.99930700e-01   1.17765172e-03   5.99858398e-03 ...,   8.07895867e-06
    6.96037757e-03   2.88335173e-05]
 [  1.37486569e-05   8.79583508e-01   1.21919470e-02 ...,   6.39660902e-05
    6.18496614e-02   6.52693937e-04]
 [  1.37304084e-02   1.29406386e-04   7.64415382e-01 ...,   1.85369163e-02
    1.47869243e-01   8.75519716e-04]
 ..., 
 [  1.05616490e-04   1.97314155e-02   5.18131605e-03 ...,   9.23514322e-01
    1.06412097e-02   3.17020571e-02]
 [  1.52880889e-02   2.60882406e-04   4.68347014e-03 ...,   4.20504403e-04
    9.46657677e-01   2.76306644e-02]
 [  1.95425914e-03   3.88063938e-03   4.48876348e-03 ...,   1.31081385e-01
    7.07875258e-02   3.66405300e-01]]
[[  8.99930700e-01   1.17765172e-03   5.99858398e-03 ...,   8.07895867e-06
    6.96037757e-03   2.88335173e-05]
 [  1.37486569e-05   8.79583508e-01   1.21919470e-02 ...,   6.39660902e-05
    6.18496614e-02   6.52693937e-04]
 [  1.37304084e-02   1.29406386e-04   7.64415382e-01 ...,   1.85369163e-02
    1.47869243e-01   8.75519716e-04]
 ..., 
 [  1.05616490e-04   1.97314155e-02   5.18131605e-03 ...,   9.23514322e-01
    1.06412097e-02   3.17020571e-02]
 [  1.52880889e-02   2.60882406e-04   4.68347014e-03 ...,   4.20504403e-04
    9.46657677e-01   2.76306644e-02]
 [  1.95425914e-03   3.88063938e-03   4.48876348e-03 ...,   1.31081385e-01
    7.07875258e-02   3.66405300e-01]]
[[  9.01011440e-01   1.15077443e-03   5.90102510e-03 ...,   7.60712458e-06
    6.84639562e-03   2.74179563e-05]
 [  1.27389068e-05   8.83492025e-01   1.17901613e-02 ...,   5.94921253e-05
    5.98657345e-02   6.14206224e-04]
 [  1.33509850e-02   1.23073843e-04   7.69446404e-01 ...,   1.79876271e-02
    1.44795004e-01   8.34997516e-04]
 ..., 
 [  1.01524991e-04   1.93424842e-02   5.09787974e-03 ...,   9.24796120e-01
    1.04856332e-02   3.12656335e-02]
 [  1.51012792e-02   2.51808562e-04   4.59774252e-03 ...,   4.08117069e-04
    9.47469798e-01   2.72616822e-02]
 [  1.93870284e-03   3.84108567e-03   4.40753468e-03 ...,   1.31400650e-01
    7.08782352e-02   3.67272817e-01]]
[[  9.01011440e-01   1.15077443e-03   5.90102510e-03 ...,   7.60712458e-06
    6.84639562e-03   2.74179563e-05]
 [  1.27389068e-05   8.83492025e-01   1.17901613e-02 ...,   5.94921253e-05
    5.98657345e-02   6.14206224e-04]
 [  1.33509850e-02   1.23073843e-04   7.69446404e-01 ...,   1.79876271e-02
    1.44795004e-01   8.34997516e-04]
 ..., 
 [  1.01524991e-04   1.93424842e-02   5.09787974e-03 ...,   9.24796120e-01
    1.04856332e-02   3.12656335e-02]
 [  1.51012792e-02   2.51808562e-04   4.59774252e-03 ...,   4.08117069e-04
    9.47469798e-01   2.72616822e-02]
 [  1.93870284e-03   3.84108567e-03   4.40753468e-03 ...,   1.31400650e-01
    7.08782352e-02   3.67272817e-01]]
[[  9.02062805e-01   1.12514104e-03   5.80675615e-03 ...,   7.16924497e-06
    6.73681916e-03   2.60912323e-05]
 [  1.18164328e-05   8.87225212e-01   1.14069692e-02 ...,   5.53865356e-05
    5.79698006e-02   5.78480960e-04]
 [  1.29861335e-02   1.17135152e-04   7.74338146e-01 ...,   1.74583663e-02
    1.41795551e-01   7.96788069e-04]
 ..., 
 [  9.76583298e-05   1.89676852e-02   5.01757375e-03 ...,   9.26030221e-01
    1.03357618e-02   3.08443583e-02]
 [  1.49208053e-02   2.43252885e-04   4.51546786e-03 ...,   3.96335732e-04
    9.48253197e-01   2.69035022e-02]
 [  1.92373704e-03   3.80287322e-03   4.32932850e-03 ...,   1.31717320e-01
    7.09663270e-02   3.68136836e-01]]
[[  9.02062805e-01   1.12514104e-03   5.80675615e-03 ...,   7.16924497e-06
    6.73681916e-03   2.60912323e-05]
 [  1.18164328e-05   8.87225212e-01   1.14069692e-02 ...,   5.53865356e-05
    5.79698006e-02   5.78480960e-04]
 [  1.29861335e-02   1.17135152e-04   7.74338146e-01 ...,   1.74583663e-02
    1.41795551e-01   7.96788069e-04]
 ..., 
 [  9.76583298e-05   1.89676852e-02   5.01757375e-03 ...,   9.26030221e-01
    1.03357618e-02   3.08443583e-02]
 [  1.49208053e-02   2.43252885e-04   4.51546786e-03 ...,   3.96335732e-04
    9.48253197e-01   2.69035022e-02]
 [  1.92373704e-03   3.80287322e-03   4.32932850e-03 ...,   1.31717320e-01
    7.09663270e-02   3.68136836e-01]]
[[  9.03086164e-01   1.10067102e-03   5.71560736e-03 ...,   6.76239499e-06
    6.63139544e-03   2.48465046e-05]
 [  1.09726291e-05   8.90792669e-01   1.10413212e-02 ...,   5.16146001e-05
    5.61571626e-02   5.45287111e-04]
 [  1.26351479e-02   1.11560830e-04   7.79094738e-01 ...,   1.69482758e-02
    1.38869524e-01   7.60734058e-04]
 ..., 
 [  9.40006015e-05   1.86062679e-02   4.94022175e-03 ...,   9.27219257e-01
    1.01912831e-02   3.04374263e-02]
 [  1.47463509e-02   2.35176107e-04   4.43644392e-03 ...,   3.85119635e-04
    9.49009411e-01   2.65556324e-02]
 [  1.90932868e-03   3.76593069e-03   4.25397747e-03 ...,   1.32031185e-01
    7.10518861e-02   3.68997559e-01]]
[[  9.03086164e-01   1.10067102e-03   5.71560736e-03 ...,   6.76239499e-06
    6.63139544e-03   2.48465046e-05]
 [  1.09726291e-05   8.90792669e-01   1.10413212e-02 ...,   5.16146001e-05
    5.61571626e-02   5.45287111e-04]
 [  1.26351479e-02   1.11560830e-04   7.79094738e-01 ...,   1.69482758e-02
    1.38869524e-01   7.60734058e-04]
 ..., 
 [  9.40006015e-05   1.86062679e-02   4.94022175e-03 ...,   9.27219257e-01
    1.01912831e-02   3.04374263e-02]
 [  1.47463509e-02   2.35176107e-04   4.43644392e-03 ...,   3.85119635e-04
    9.49009411e-01   2.65556324e-02]
 [  1.90932868e-03   3.76593069e-03   4.25397747e-03 ...,   1.32031185e-01
    7.10518861e-02   3.68997559e-01]]
[[  9.04082793e-01   1.07729039e-03   5.62742070e-03 ...,   6.38394391e-06
    6.52989036e-03   2.36775592e-05]
 [  1.01998379e-05   8.94203393e-01   1.06922359e-02 ...,   4.81452714e-05
    5.44234024e-02   5.14415549e-04]
 [  1.22973635e-02   1.06323971e-04   7.83720208e-01 ...,   1.64565402e-02
    1.36015512e-01   7.26690685e-04]
 ..., 
 [  9.05372662e-05   1.82575338e-02   4.86566023e-03 ...,   9.28365671e-01
    1.00519069e-02   3.00440876e-02]
 [  1.45776203e-02   2.27542596e-04   4.36048374e-03 ...,   3.74431470e-04
    9.49739866e-01   2.62176115e-02]
 [  1.89544705e-03   3.73019175e-03   4.18132613e-03 ...,   1.32342060e-01
    7.11349943e-02   3.69855180e-01]]
[[  9.04082793e-01   1.07729039e-03   5.62742070e-03 ...,   6.38394391e-06
    6.52989036e-03   2.36775592e-05]
 [  1.01998379e-05   8.94203393e-01   1.06922359e-02 ...,   4.81452714e-05
    5.44234024e-02   5.14415549e-04]
 [  1.22973635e-02   1.06323971e-04   7.83720208e-01 ...,   1.64565402e-02
    1.36015512e-01   7.26690685e-04]
 ..., 
 [  9.05372662e-05   1.82575338e-02   4.86566023e-03 ...,   9.28365671e-01
    1.00519069e-02   3.00440876e-02]
 [  1.45776203e-02   2.27542596e-04   4.36048374e-03 ...,   3.74431470e-04
    9.49739866e-01   2.62176115e-02]
 [  1.89544705e-03   3.73019175e-03   4.18132613e-03 ...,   1.32342060e-01
    7.11349943e-02   3.69855180e-01]]
[[  9.05053889e-01   1.05493107e-03   5.54204892e-03 ...,   6.03152132e-06
    6.43208679e-03   2.25787419e-05]
 [  9.49123511e-06   8.97465820e-01   1.03587953e-02 ...,   4.49507463e-05
    5.27643634e-02   4.85676742e-04]
 [  1.19721540e-02   1.01399984e-04   7.88218488e-01 ...,   1.59823839e-02
    1.33232060e-01   6.94524519e-04]
 ..., 
 [  8.72550148e-05   1.79208318e-02   4.79373729e-03 ...,   9.29471738e-01
    9.91736340e-03   2.96636424e-02]
 [  1.44143372e-02   2.20319964e-04   4.28741428e-03 ...,   3.64237033e-04
    9.50445888e-01   2.58890065e-02]
 [  1.88206357e-03   3.69559465e-03   4.11122995e-03 ...,   1.32649777e-01
    7.12157305e-02   3.70709877e-01]]
[[  9.05053889e-01   1.05493107e-03   5.54204892e-03 ...,   6.03152132e-06
    6.43208679e-03   2.25787419e-05]
 [  9.49123511e-06   8.97465820e-01   1.03587953e-02 ...,   4.49507463e-05
    5.27643634e-02   4.85676742e-04]
 [  1.19721540e-02   1.01399984e-04   7.88218488e-01 ...,   1.59823839e-02
    1.33232060e-01   6.94524519e-04]
 ..., 
 [  8.72550148e-05   1.79208318e-02   4.79373729e-03 ...,   9.29471738e-01
    9.91736340e-03   2.96636424e-02]
 [  1.44143372e-02   2.20319964e-04   4.28741428e-03 ...,   3.64237033e-04
    9.50445888e-01   2.58890065e-02]
 [  1.88206357e-03   3.69559465e-03   4.11122995e-03 ...,   1.32649777e-01
    7.12157305e-02   3.70709877e-01]]
[[  9.06000570e-01   1.03353038e-03   5.45935463e-03 ...,   5.70298772e-06
    6.33778313e-03   2.15449002e-05]
 [  8.84072973e-06   9.00587864e-01   1.00401400e-02 ...,   4.20060899e-05
    5.11761346e-02   4.58898705e-04]
 [  1.16589291e-02   9.67663678e-05   7.92593406e-01 ...,   1.55250693e-02
    1.30517684e-01   6.64112468e-04]
 ..., 
 [  8.41416463e-05   1.75955544e-02   4.72431173e-03 ...,   9.30539575e-01
    9.78740115e-03   2.92954376e-02]
 [  1.42562430e-02   2.13478721e-04   4.21707512e-03 ...,   3.54504912e-04
    9.51128712e-01   2.55694104e-02]
 [  1.86915166e-03   3.66208181e-03   4.04355440e-03 ...,   1.32954189e-01
    7.12941707e-02   3.71561818e-01]]
[[  9.06000570e-01   1.03353038e-03   5.45935463e-03 ...,   5.70298772e-06
    6.33778313e-03   2.15449002e-05]
 [  8.84072973e-06   9.00587864e-01   1.00401400e-02 ...,   4.20060899e-05
    5.11761346e-02   4.58898705e-04]
 [  1.16589291e-02   9.67663678e-05   7.92593406e-01 ...,   1.55250693e-02
    1.30517684e-01   6.64112468e-04]
 ..., 
 [  8.41416463e-05   1.75955544e-02   4.72431173e-03 ...,   9.30539575e-01
    9.78740115e-03   2.92954376e-02]
 [  1.42562430e-02   2.13478721e-04   4.21707512e-03 ...,   3.54504912e-04
    9.51128712e-01   2.55694104e-02]
 [  1.86915166e-03   3.66208181e-03   4.04355440e-03 ...,   1.32954189e-01
    7.12941707e-02   3.71561818e-01]]
[[  9.06923884e-01   1.01303047e-03   5.37920944e-03 ...,   5.39640879e-06
    6.24679197e-03   2.05713310e-05]
 [  8.24287745e-06   9.03576953e-01   9.73546524e-03 ...,   3.92889084e-05
    4.96550355e-02   4.33925195e-04]
 [  1.13571317e-02   9.24025085e-05   7.96848695e-01 ...,   1.50838942e-02
    1.27870877e-01   6.35340847e-04]
 ..., 
 [  8.11859595e-05   1.72811340e-02   4.65725210e-03 ...,   9.31571156e-01
    9.66178579e-03   2.89388629e-02]
 [  1.41030951e-02   2.06991970e-04   4.14931733e-03 ...,   3.45206215e-04
    9.51789491e-01   2.52584403e-02]
 [  1.85668652e-03   3.62959947e-03   3.97817413e-03 ...,   1.33255164e-01
    7.13703877e-02   3.72411161e-01]]
[[  9.06923884e-01   1.01303047e-03   5.37920944e-03 ...,   5.39640879e-06
    6.24679197e-03   2.05713310e-05]
 [  8.24287745e-06   9.03576953e-01   9.73546524e-03 ...,   3.92889084e-05
    4.96550355e-02   4.33925195e-04]
 [  1.13571317e-02   9.24025085e-05   7.96848695e-01 ...,   1.50838942e-02
    1.27870877e-01   6.35340847e-04]
 ..., 
 [  8.11859595e-05   1.72811340e-02   4.65725210e-03 ...,   9.31571156e-01
    9.66178579e-03   2.89388629e-02]
 [  1.41030951e-02   2.06991970e-04   4.14931733e-03 ...,   3.45206215e-04
    9.51789491e-01   2.52584403e-02]
 [  1.85668652e-03   3.62959947e-03   3.97817413e-03 ...,   1.33255164e-01
    7.13703877e-02   3.72411161e-01]]
[[  9.07824815e-01   9.93377900e-04   5.30149330e-03 ...,   5.11003286e-06
    6.15893889e-03   1.96537361e-05]
 [  7.69280484e-06   9.06440061e-01   9.44401686e-03 ...,   3.67790625e-05
    4.81976014e-02   4.10614108e-04]
 [  1.10662360e-02   8.82894985e-05   8.00987982e-01 ...,   1.46581902e-02
    1.25290118e-01   6.08104557e-04]
 ..., 
 [  7.83776575e-05   1.69770398e-02   4.59243588e-03 ...,   9.32568322e-01
    9.54029854e-03   2.85933469e-02]
 [  1.39546663e-02   2.00835145e-04   4.08400253e-03 ...,   3.36314328e-04
    9.52429302e-01   2.49557357e-02]
 [  1.84464501e-03   3.59809743e-03   3.91497220e-03 ...,   1.33552585e-01
    7.14444515e-02   3.73258054e-01]]
[[  9.07824815e-01   9.93377900e-04   5.30149330e-03 ...,   5.11003286e-06
    6.15893889e-03   1.96537361e-05]
 [  7.69280484e-06   9.06440061e-01   9.44401686e-03 ...,   3.67790625e-05
    4.81976014e-02   4.10614108e-04]
 [  1.10662360e-02   8.82894985e-05   8.00987982e-01 ...,   1.46581902e-02
    1.25290118e-01   6.08104557e-04]
 ..., 
 [  7.83776575e-05   1.69770398e-02   4.59243588e-03 ...,   9.32568322e-01
    9.54029854e-03   2.85933469e-02]
 [  1.39546663e-02   2.00835145e-04   4.08400253e-03 ...,   3.36314328e-04
    9.52429302e-01   2.49557357e-02]
 [  1.84464501e-03   3.59809743e-03   3.91497220e-03 ...,   1.33552585e-01
    7.14444515e-02   3.73258054e-01]]
[[  9.08704287e-01   9.74523254e-04   5.22609373e-03 ...,   4.84227127e-06
    6.07406136e-03   1.87881808e-05]
 [  7.18614337e-06   9.09183738e-01   9.16508782e-03 ...,   3.44584156e-05
    4.68005703e-02   3.88836046e-04]
 [  1.07857453e-02   8.44099750e-05   8.05014799e-01 ...,   1.42473203e-02
    1.22773879e-01   5.82306334e-04]
 ..., 
 [  7.57072618e-05   1.66827750e-02   4.52974878e-03 ...,   9.33532795e-01
    9.42273494e-03   2.82583551e-02]
 [  1.38107428e-02   1.94985768e-04   4.02100191e-03 ...,   3.27804699e-04
    9.53049149e-01   2.46609565e-02]
 [  1.83300551e-03   3.56752869e-03   3.85383939e-03 ...,   1.33846351e-01
    7.15164291e-02   3.74102634e-01]]
[[  9.08704287e-01   9.74523254e-04   5.22609373e-03 ...,   4.84227127e-06
    6.07406136e-03   1.87881808e-05]
 [  7.18614337e-06   9.09183738e-01   9.16508782e-03 ...,   3.44584156e-05
    4.68005703e-02   3.88836046e-04]
 [  1.07857453e-02   8.44099750e-05   8.05014799e-01 ...,   1.42473203e-02
    1.22773879e-01   5.82306334e-04]
 ..., 
 [  7.57072618e-05   1.66827750e-02   4.52974878e-03 ...,   9.33532795e-01
    9.42273494e-03   2.82583551e-02]
 [  1.38107428e-02   1.94985768e-04   4.02100191e-03 ...,   3.27804699e-04
    9.53049149e-01   2.46609565e-02]
 [  1.83300551e-03   3.56752869e-03   3.85383939e-03 ...,   1.33846351e-01
    7.15164291e-02   3.74102634e-01]]
[[  9.09563170e-01   9.56420755e-04   5.15290532e-03 ...,   4.59168099e-06
    5.99200779e-03   1.79710590e-05]
 [  6.71897178e-06   9.11814143e-01   8.89801493e-03 ...,   3.23106140e-05
    4.54608700e-02   3.68473060e-04]
 [  1.05151900e-02   8.07479762e-05   8.08932575e-01 ...,   1.38506779e-02
    1.20320632e-01   5.57856079e-04]
 ..., 
 [  7.31660362e-05   1.63978736e-02   4.46908402e-03 ...,   9.34466185e-01
    9.30890370e-03   2.79333861e-02]
 [  1.36711238e-02   1.89423246e-04   3.96019549e-03 ...,   3.19654648e-04
    9.53649975e-01   2.43737818e-02]
 [  1.82174780e-03   3.53784924e-03   3.79467358e-03 ...,   1.34136372e-01
    7.15863847e-02   3.74945032e-01]]
[[  9.09563170e-01   9.56420755e-04   5.15290532e-03 ...,   4.59168099e-06
    5.99200779e-03   1.79710590e-05]
 [  6.71897178e-06   9.11814143e-01   8.89801493e-03 ...,   3.23106140e-05
    4.54608700e-02   3.68473060e-04]
 [  1.05151900e-02   8.07479762e-05   8.08932575e-01 ...,   1.38506779e-02
    1.20320632e-01   5.57856079e-04]
 ..., 
 [  7.31660362e-05   1.63978736e-02   4.46908402e-03 ...,   9.34466185e-01
    9.30890370e-03   2.79333861e-02]
 [  1.36711238e-02   1.89423246e-04   3.96019549e-03 ...,   3.19654648e-04
    9.53649975e-01   2.43737818e-02]
 [  1.82174780e-03   3.53784924e-03   3.79467358e-03 ...,   1.34136372e-01
    7.15863847e-02   3.74945032e-01]]
[[  9.10402283e-01   9.39027960e-04   5.08182911e-03 ...,   4.35694936e-06
    5.91263664e-03   1.71990610e-05]
 [  6.28776554e-06   9.14337064e-01   8.64217575e-03 ...,   3.03208923e-05
    4.41756065e-02   3.49417514e-04]
 [  1.02541261e-02   7.72888126e-05   8.12744644e-01 ...,   1.34676844e-02
    1.17928851e-01   5.34670249e-04]
 ..., 
 [  7.07459183e-05   1.61218986e-02   4.41034181e-03 ...,   9.35369998e-01
    9.19862570e-03   2.76179698e-02]
 [  1.35356205e-02   1.84128681e-04   3.90147133e-03 ...,   3.11843196e-04
    9.54232661e-01   2.40939085e-02]
 [  1.81085294e-03   3.50901782e-03   3.73737919e-03 ...,   1.34422569e-01
    7.16543796e-02   3.75785368e-01]]
[[  9.10402283e-01   9.39027960e-04   5.08182911e-03 ...,   4.35694936e-06
    5.91263664e-03   1.71990610e-05]
 [  6.28776554e-06   9.14337064e-01   8.64217575e-03 ...,   3.03208923e-05
    4.41756065e-02   3.49417514e-04]
 [  1.02541261e-02   7.72888126e-05   8.12744644e-01 ...,   1.34676844e-02
    1.17928851e-01   5.34670249e-04]
 ..., 
 [  7.07459183e-05   1.61218986e-02   4.41034181e-03 ...,   9.35369998e-01
    9.19862570e-03   2.76179698e-02]
 [  1.35356205e-02   1.84128681e-04   3.90147133e-03 ...,   3.11843196e-04
    9.54232661e-01   2.40939085e-02]
 [  1.81085294e-03   3.50901782e-03   3.73737919e-03 ...,   1.34422569e-01
    7.16543796e-02   3.75785368e-01]]
[[  9.11222397e-01   9.22305461e-04   5.01277211e-03 ...,   4.13688064e-06
    5.83581558e-03   1.64691452e-05]
 [  5.88935261e-06   9.16757948e-01   8.39698583e-03 ...,   2.84759028e-05
    4.29420525e-02   3.31571085e-04]
 [  1.00021332e-02   7.40189507e-05   8.16454242e-01 ...,   1.30977883e-02
    1.15597021e-01   5.12671315e-04]
 ..., 
 [  6.84394590e-05   1.58544398e-02   4.35342870e-03 ...,   9.36245648e-01
    9.09173300e-03   2.73116645e-02]
 [  1.34040548e-02   1.79084710e-04   3.84472489e-03 ...,   3.04350910e-04
    9.54798036e-01   2.38210496e-02]
 [  1.80030317e-03   3.48099571e-03   3.68186669e-03 ...,   1.34704875e-01
    7.17204725e-02   3.76623756e-01]]
[[  9.11222397e-01   9.22305461e-04   5.01277211e-03 ...,   4.13688064e-06
    5.83581558e-03   1.64691452e-05]
 [  5.88935261e-06   9.16757948e-01   8.39698583e-03 ...,   2.84759028e-05
    4.29420525e-02   3.31571085e-04]
 [  1.00021332e-02   7.40189507e-05   8.16454242e-01 ...,   1.30977883e-02
    1.15597021e-01   5.12671315e-04]
 ..., 
 [  6.84394590e-05   1.58544398e-02   4.35342870e-03 ...,   9.36245648e-01
    9.09173300e-03   2.73116645e-02]
 [  1.34040548e-02   1.79084710e-04   3.84472489e-03 ...,   3.04350910e-04
    9.54798036e-01   2.38210496e-02]
 [  1.80030317e-03   3.48099571e-03   3.68186669e-03 ...,   1.34704875e-01
    7.17204725e-02   3.76623756e-01]]
[[  9.12024239e-01   9.06216632e-04   4.94564687e-03 ...,   3.93038413e-06
    5.76142083e-03   1.57785133e-05]
 [  5.52087449e-06   9.19081918e-01   8.16189610e-03 ...,   2.67635648e-05
    4.17576373e-02   3.14843861e-04]
 [  9.75881358e-03   7.09259097e-05   8.20064508e-01 ...,   1.27404635e-02
    1.13323640e-01   4.91787261e-04]
 ..., 
 [  6.62397675e-05   1.55951112e-02   4.29825718e-03 ...,   9.37094460e-01
    8.98806799e-03   2.70140553e-02]
 [  1.32762590e-02   1.74275357e-04   3.78985846e-03 ...,   2.97159767e-04
    9.55346877e-01   2.35549339e-02]
 [  1.79008185e-03   3.45374652e-03   3.62805212e-03 ...,   1.34983233e-01
    7.17847195e-02   3.77460302e-01]]
[[  9.12024239e-01   9.06216632e-04   4.94564687e-03 ...,   3.93038413e-06
    5.76142083e-03   1.57785133e-05]
 [  5.52087449e-06   9.19081918e-01   8.16189610e-03 ...,   2.67635648e-05
    4.17576373e-02   3.14843861e-04]
 [  9.75881358e-03   7.09259097e-05   8.20064508e-01 ...,   1.27404635e-02
    1.13323640e-01   4.91787261e-04]
 ..., 
 [  6.62397675e-05   1.55951112e-02   4.29825718e-03 ...,   9.37094460e-01
    8.98806799e-03   2.70140553e-02]
 [  1.32762590e-02   1.74275357e-04   3.78985846e-03 ...,   2.97159767e-04
    9.55346877e-01   2.35549339e-02]
 [  1.79008185e-03   3.45374652e-03   3.62805212e-03 ...,   1.34983233e-01
    7.17847195e-02   3.77460302e-01]]
[[  9.12808499e-01   8.90727391e-04   4.88037107e-03 ...,   3.73646360e-06
    5.68933644e-03   1.51245875e-05]
 [  5.17975207e-06   9.21313801e-01   7.93639045e-03 ...,   2.51729313e-05
    4.06199371e-02   2.99153539e-04]
 [  9.52379017e-03   6.79981678e-05   8.23578489e-01 ...,   1.23952078e-02
    1.11107221e-01   4.71951136e-04]
 ..., 
 [  6.41404621e-05   1.53435500e-02   4.24474516e-03 ...,   9.37917677e-01
    8.88748267e-03   2.67247518e-02]
 [  1.31520746e-02   1.69685902e-04   3.73678058e-03 ...,   2.90253033e-04
    9.55879915e-01   2.32953043e-02]
 [  1.78017334e-03   3.42723604e-03   3.57585664e-03 ...,   1.35257592e-01
    7.18471741e-02   3.78295105e-01]]
[[  9.12808499e-01   8.90727391e-04   4.88037107e-03 ...,   3.73646360e-06
    5.68933644e-03   1.51245875e-05]
 [  5.17975207e-06   9.21313801e-01   7.93639045e-03 ...,   2.51729313e-05
    4.06199371e-02   2.99153539e-04]
 [  9.52379017e-03   6.79981678e-05   8.23578489e-01 ...,   1.23952078e-02
    1.11107221e-01   4.71951136e-04]
 ..., 
 [  6.41404621e-05   1.53435500e-02   4.24474516e-03 ...,   9.37917677e-01
    8.88748267e-03   2.67247518e-02]
 [  1.31520746e-02   1.69685902e-04   3.73678058e-03 ...,   2.90253033e-04
    9.55879915e-01   2.32953043e-02]
 [  1.78017334e-03   3.42723604e-03   3.57585664e-03 ...,   1.35257592e-01
    7.18471741e-02   3.78295105e-01]]
[[  9.13575825e-01   8.75805986e-04   4.81686708e-03 ...,   3.55420793e-06
    5.61945370e-03   1.45049902e-05]
 [  4.86365549e-06   9.23458142e-01   7.71998353e-03 ...,   2.36940711e-05
    3.95266653e-02   2.84424709e-04]
 [  9.29670568e-03   6.52250785e-05   8.26999139e-01 ...,   1.20615420e-02
    1.08946296e-01   4.53100648e-04]
 ..., 
 [  6.21356264e-05   1.50994143e-02   4.19281561e-03 ...,   9.38716468e-01
    8.78983784e-03   2.64433867e-02]
 [  1.30313521e-02   1.65302767e-04   3.68540558e-03 ...,   2.83615149e-04
    9.56397838e-01   2.30419168e-02]
 [  1.77056293e-03   3.40143206e-03   3.52520620e-03 ...,   1.35527913e-01
    7.19078875e-02   3.79128258e-01]]
[[  9.13575825e-01   8.75805986e-04   4.81686708e-03 ...,   3.55420793e-06
    5.61945370e-03   1.45049902e-05]
 [  4.86365549e-06   9.23458142e-01   7.71998353e-03 ...,   2.36940711e-05
    3.95266653e-02   2.84424709e-04]
 [  9.29670568e-03   6.52250785e-05   8.26999139e-01 ...,   1.20615420e-02
    1.08946296e-01   4.53100648e-04]
 ..., 
 [  6.21356264e-05   1.50994143e-02   4.19281561e-03 ...,   9.38716468e-01
    8.78983784e-03   2.64433867e-02]
 [  1.30313521e-02   1.65302767e-04   3.68540558e-03 ...,   2.83615149e-04
    9.56397838e-01   2.30419168e-02]
 [  1.77056293e-03   3.40143206e-03   3.52520620e-03 ...,   1.35527913e-01
    7.19078875e-02   3.79128258e-01]]
[[  9.14326833e-01   8.61422810e-04   4.75506172e-03 ...,   3.38278286e-06
    5.55167061e-03   1.39175265e-05]
 [  4.57047747e-06   9.25519224e-01   7.51221868e-03 ...,   2.23179647e-05
    3.84756647e-02   2.70588205e-04]
 [  9.07722124e-03   6.25967942e-05   8.30329322e-01 ...,   1.17390088e-02
    1.06839419e-01   4.35177792e-04]
 ..., 
 [  6.02197689e-05   1.48623819e-02   4.14239613e-03 ...,   9.39491934e-01
    8.69500256e-03   2.61696138e-02]
 [  1.29139502e-02   1.61113409e-04   3.63565309e-03 ...,   2.77231637e-04
    9.56901293e-01   2.27945402e-02]
 [  1.76123680e-03   3.37630424e-03   3.47603117e-03 ...,   1.35794160e-01
    7.19669086e-02   3.79959848e-01]]
[[  9.14326833e-01   8.61422810e-04   4.75506172e-03 ...,   3.38278286e-06
    5.55167061e-03   1.39175265e-05]
 [  4.57047747e-06   9.25519224e-01   7.51221868e-03 ...,   2.23179647e-05
    3.84756647e-02   2.70588205e-04]
 [  9.07722124e-03   6.25967942e-05   8.30329322e-01 ...,   1.17390088e-02
    1.06839419e-01   4.35177792e-04]
 ..., 
 [  6.02197689e-05   1.48623819e-02   4.14239613e-03 ...,   9.39491934e-01
    8.69500256e-03   2.61696138e-02]
 [  1.29139502e-02   1.61113409e-04   3.63565309e-03 ...,   2.77231637e-04
    9.56901293e-01   2.27945402e-02]
 [  1.76123680e-03   3.37630424e-03   3.47603117e-03 ...,   1.35794160e-01
    7.19669086e-02   3.79959848e-01]]
[[  9.15062106e-01   8.47550222e-04   4.69488587e-03 ...,   3.22142354e-06
    5.48589138e-03   1.33601675e-05]
 [  4.29830994e-06   9.27501086e-01   7.31266601e-03 ...,   2.10364112e-05
    3.74648989e-02   2.57580532e-04]
 [  8.86501534e-03   6.01041985e-05   8.33571812e-01 ...,   1.14271709e-02
    1.04785168e-01   4.18128515e-04]
 ..., 
 [  5.83877877e-05   1.46321490e-02   4.09341867e-03 ...,   9.40245109e-01
    8.60285347e-03   2.59031066e-02]
 [  1.27997352e-02   1.57106229e-04   3.58744770e-03 ...,   2.71089002e-04
    9.57390891e-01   2.25529548e-02]
 [  1.75218193e-03   3.35182396e-03   3.42826598e-03 ...,   1.36056309e-01
    7.20242839e-02   3.80789956e-01]]
[[  9.15062106e-01   8.47550222e-04   4.69488587e-03 ...,   3.22142354e-06
    5.48589138e-03   1.33601675e-05]
 [  4.29830994e-06   9.27501086e-01   7.31266601e-03 ...,   2.10364112e-05
    3.74648989e-02   2.57580532e-04]
 [  8.86501534e-03   6.01041985e-05   8.33571812e-01 ...,   1.14271709e-02
    1.04785168e-01   4.18128515e-04]
 ..., 
 [  5.83877877e-05   1.46321490e-02   4.09341867e-03 ...,   9.40245109e-01
    8.60285347e-03   2.59031066e-02]
 [  1.27997352e-02   1.57106229e-04   3.58744770e-03 ...,   2.71089002e-04
    9.57390891e-01   2.25529548e-02]
 [  1.75218193e-03   3.35182396e-03   3.42826598e-03 ...,   1.36056309e-01
    7.20242839e-02   3.80789956e-01]]
[[  9.15782197e-01   8.34162392e-04   4.63627420e-03 ...,   3.06942792e-06
    5.42202593e-03   1.28310358e-05]
 [  4.04542313e-06   9.29407537e-01   7.12092064e-03 ...,   1.98419461e-05
    3.64924454e-02   2.45343347e-04]
 [  8.65978277e-03   5.77388437e-05   8.36729299e-01 ...,   1.11256112e-02
    1.02782145e-01   4.01902406e-04]
 ..., 
 [  5.66349378e-05   1.44084284e-02   4.04581917e-03 ...,   9.40976970e-01
    8.51327428e-03   2.56435572e-02]
 [  1.26885804e-02   1.53270486e-04   3.54071854e-03 ...,   2.65174660e-04
    9.57867209e-01   2.23169516e-02]
 [  1.74338603e-03   3.32796423e-03   3.38184891e-03 ...,   1.36314337e-01
    7.20800580e-02   3.81618658e-01]]
[[  9.15782197e-01   8.34162392e-04   4.63627420e-03 ...,   3.06942792e-06
    5.42202593e-03   1.28310358e-05]
 [  4.04542313e-06   9.29407537e-01   7.12092064e-03 ...,   1.98419461e-05
    3.64924454e-02   2.45343347e-04]
 [  8.65978277e-03   5.77388437e-05   8.36729299e-01 ...,   1.11256112e-02
    1.02782145e-01   4.01902406e-04]
 ..., 
 [  5.66349378e-05   1.44084284e-02   4.04581917e-03 ...,   9.40976970e-01
    8.51327428e-03   2.56435572e-02]
 [  1.26885804e-02   1.53270486e-04   3.54071854e-03 ...,   2.65174660e-04
    9.57867209e-01   2.23169516e-02]
 [  1.74338603e-03   3.32796423e-03   3.38184891e-03 ...,   1.36314337e-01
    7.20800580e-02   3.81618658e-01]]
[[  9.16487629e-01   8.21235159e-04   4.57916493e-03 ...,   2.92615092e-06
    5.35998953e-03   1.23283927e-05]
 [  3.81024723e-06   9.31242174e-01   6.93660108e-03 ...,   1.87277681e-05
    3.55564878e-02   2.33822988e-04]
 [  8.46123364e-03   5.54928954e-05   8.39804386e-01 ...,   1.08339305e-02
    1.00828979e-01   3.86452417e-04]
 ..., 
 [  5.49568018e-05   1.41909492e-02   3.99953729e-03 ...,   9.41688435e-01
    8.42615531e-03   2.53906746e-02]
 [  1.25803660e-02   1.49596226e-04   3.49539898e-03 ...,   2.59476858e-04
    9.58330790e-01   2.20863322e-02]
 [  1.73483754e-03   3.30469952e-03   3.33672172e-03 ...,   1.36568229e-01
    7.21342732e-02   3.82446024e-01]]
[[  9.16487629e-01   8.21235159e-04   4.57916493e-03 ...,   2.92615092e-06
    5.35998953e-03   1.23283927e-05]
 [  3.81024723e-06   9.31242174e-01   6.93660108e-03 ...,   1.87277681e-05
    3.55564878e-02   2.33822988e-04]
 [  8.46123364e-03   5.54928954e-05   8.39804386e-01 ...,   1.08339305e-02
    1.00828979e-01   3.86452417e-04]
 ..., 
 [  5.49568018e-05   1.41909492e-02   3.99953729e-03 ...,   9.41688435e-01
    8.42615531e-03   2.53906746e-02]
 [  1.25803660e-02   1.49596226e-04   3.49539898e-03 ...,   2.59476858e-04
    9.58330790e-01   2.20863322e-02]
 [  1.73483754e-03   3.30469952e-03   3.33672172e-03 ...,   1.36568229e-01
    7.21342732e-02   3.82446024e-01]]
[[  9.17178900e-01   8.08745901e-04   4.52349958e-03 ...,   2.79099911e-06
    5.29970237e-03   1.18506261e-05]
 [  3.59135601e-06   9.33008389e-01   6.75934767e-03 ...,   1.76876737e-05
    3.46553103e-02   2.22970057e-04]
 [  8.26909253e-03   5.33590811e-05   8.42799595e-01 ...,   1.05517478e-02
    9.89243273e-02   3.71734611e-04]
 ..., 
 [  5.33492630e-05   1.39794549e-02   3.95451614e-03 ...,   9.42380373e-01
    8.34139296e-03   2.51441840e-02]
 [  1.24749780e-02   1.46074211e-04   3.45142628e-03 ...,   2.53984611e-04
    9.58782150e-01   2.18609073e-02]
 [  1.72652552e-03   3.28200574e-03   3.29282949e-03 ...,   1.36817977e-01
    7.21869701e-02   3.83272122e-01]]
[[  9.17178900e-01   8.08745901e-04   4.52349958e-03 ...,   2.79099911e-06
    5.29970237e-03   1.18506261e-05]
 [  3.59135601e-06   9.33008389e-01   6.75934767e-03 ...,   1.76876737e-05
    3.46553103e-02   2.22970057e-04]
 [  8.26909253e-03   5.33590811e-05   8.42799595e-01 ...,   1.05517478e-02
    9.89243273e-02   3.71734611e-04]
 ..., 
 [  5.33492630e-05   1.39794549e-02   3.95451614e-03 ...,   9.42380373e-01
    8.34139296e-03   2.51441840e-02]
 [  1.24749780e-02   1.46074211e-04   3.45142628e-03 ...,   2.53984611e-04
    9.58782150e-01   2.18609073e-02]
 [  1.72652552e-03   3.28200574e-03   3.29282949e-03 ...,   1.36817977e-01
    7.21869701e-02   3.83272122e-01]]
[[  9.17856484e-01   7.96673415e-04   4.46922272e-03 ...,   2.66342599e-06
    5.24108926e-03   1.13962398e-05]
 [  3.38745233e-06   9.34709388e-01   6.58882119e-03 ...,   1.67159992e-05
    3.37872907e-02   2.12739043e-04]
 [  8.08309762e-03   5.13306450e-05   8.45717366e-01 ...,   1.02786985e-02
    9.70668740e-02   3.57707922e-04]
 ..., 
 [  5.18084820e-05   1.37737029e-02   3.91070207e-03 ...,   9.43053604e-01
    8.25888935e-03   2.49038255e-02]
 [  1.23723087e-02   1.42695858e-04   3.40874134e-03 ...,   2.48687641e-04
    9.59221776e-01   2.16404971e-02]
 [  1.71843967e-03   3.25986007e-03   3.25012035e-03 ...,   1.37063573e-01
    7.22381873e-02   3.84097012e-01]]
[[  9.17856484e-01   7.96673415e-04   4.46922272e-03 ...,   2.66342599e-06
    5.24108926e-03   1.13962398e-05]
 [  3.38745233e-06   9.34709388e-01   6.58882119e-03 ...,   1.67159992e-05
    3.37872907e-02   2.12739043e-04]
 [  8.08309762e-03   5.13306450e-05   8.45717366e-01 ...,   1.02786985e-02
    9.70668740e-02   3.57707922e-04]
 ..., 
 [  5.18084820e-05   1.37737029e-02   3.91070207e-03 ...,   9.43053604e-01
    8.25888935e-03   2.49038255e-02]
 [  1.23723087e-02   1.42695858e-04   3.40874134e-03 ...,   2.48687641e-04
    9.59221776e-01   2.16404971e-02]
 [  1.71843967e-03   3.25986007e-03   3.25012035e-03 ...,   1.37063573e-01
    7.22381873e-02   3.84097012e-01]]
[[  9.18520831e-01   7.84997815e-04   4.41628183e-03 ...,   2.54292777e-06
    5.18407924e-03   1.09638440e-05]
 [  3.19735517e-06   9.36348200e-01   6.42470154e-03 ...,   1.58075681e-05
    3.29508950e-02   2.03087977e-04]
 [  7.90299990e-03   4.94013055e-05   8.48560064e-01 ...,   1.00144340e-02
    9.52553334e-02   3.44333944e-04]
 ..., 
 [  5.03308741e-05   1.35734635e-02   3.86804439e-03 ...,   9.43708902e-01
    8.17855193e-03   2.46693530e-02]
 [  1.22722556e-02   1.39453186e-04   3.36728844e-03 ...,   2.43576321e-04
    9.59650128e-01   2.14249297e-02]
 [  1.71057022e-03   3.23824090e-03   3.20854528e-03 ...,   1.37305019e-01
    7.22879617e-02   3.84920752e-01]]
[[  9.18520831e-01   7.84997815e-04   4.41628183e-03 ...,   2.54292777e-06
    5.18407924e-03   1.09638440e-05]
 [  3.19735517e-06   9.36348200e-01   6.42470154e-03 ...,   1.58075681e-05
    3.29508950e-02   2.03087977e-04]
 [  7.90299990e-03   4.94013055e-05   8.48560064e-01 ...,   1.00144340e-02
    9.52553334e-02   3.44333944e-04]
 ..., 
 [  5.03308741e-05   1.35734635e-02   3.86804439e-03 ...,   9.43708902e-01
    8.17855193e-03   2.46693530e-02]
 [  1.22722556e-02   1.39453186e-04   3.36728844e-03 ...,   2.43576321e-04
    9.59650128e-01   2.14249297e-02]
 [  1.71057022e-03   3.23824090e-03   3.20854528e-03 ...,   1.37305019e-01
    7.22879617e-02   3.84920752e-01]]
[[  9.19172370e-01   7.73700426e-04   4.36462703e-03 ...,   2.42903955e-06
    5.12860534e-03   1.05521466e-05]
 [  3.01998820e-06   9.37927690e-01   6.26668652e-03 ...,   1.49576452e-05
    3.21446722e-02   1.93978125e-04]
 [  7.72856246e-03   4.75652176e-05   8.51329973e-01 ...,   9.75862088e-03
    9.34884489e-02   3.31576736e-04]
 ..., 
 [  4.89130899e-05   1.33785190e-02   3.82649524e-03 ...,   9.44347001e-01
    8.10029310e-03   2.44405335e-02]
 [  1.21747213e-02   1.36338765e-04   3.32701500e-03 ...,   2.38641627e-04
    9.60067644e-01   2.12140415e-02]
 [  1.70290793e-03   3.21712778e-03   3.16805792e-03 ...,   1.37542315e-01
    7.23363286e-02   3.85743395e-01]]
[[  9.19172370e-01   7.73700426e-04   4.36462703e-03 ...,   2.42903955e-06
    5.12860534e-03   1.05521466e-05]
 [  3.01998820e-06   9.37927690e-01   6.26668652e-03 ...,   1.49576452e-05
    3.21446722e-02   1.93978125e-04]
 [  7.72856246e-03   4.75652176e-05   8.51329973e-01 ...,   9.75862088e-03
    9.34884489e-02   3.31576736e-04]
 ..., 
 [  4.89130899e-05   1.33785190e-02   3.82649524e-03 ...,   9.44347001e-01
    8.10029310e-03   2.44405335e-02]
 [  1.21747213e-02   1.36338765e-04   3.32701500e-03 ...,   2.38641627e-04
    9.60067644e-01   2.12140415e-02]
 [  1.70290793e-03   3.21712778e-03   3.16805792e-03 ...,   1.37542315e-01
    7.23363286e-02   3.85743395e-01]]
[[  9.19811508e-01   7.62763702e-04   4.31421098e-03 ...,   2.32133189e-06
    5.07460431e-03   1.01599451e-05]
 [  2.85436947e-06   9.39450565e-01   6.11449072e-03 ...,   1.41618947e-05
    3.13672492e-02   1.85373708e-04]
 [  7.55955980e-03   4.58169384e-05   8.54029308e-01 ...,   9.51094021e-03
    9.17649937e-02   3.19402643e-04]
 ..., 
 [  4.75519967e-05   1.31886628e-02   3.78600932e-03 ...,   9.44968594e-01
    8.02402988e-03   2.42171463e-02]
 [  1.20796132e-02   1.33345671e-04   3.28787135e-03 ...,   2.33875092e-04
    9.60474737e-01   2.10076763e-02]
 [  1.69544408e-03   3.19650130e-03   3.12861439e-03 ...,   1.37775469e-01
    7.23833217e-02   3.86564993e-01]]
[[  9.19811508e-01   7.62763702e-04   4.31421098e-03 ...,   2.32133189e-06
    5.07460431e-03   1.01599451e-05]
 [  2.85436947e-06   9.39450565e-01   6.11449072e-03 ...,   1.41618947e-05
    3.13672492e-02   1.85373708e-04]
 [  7.55955980e-03   4.58169384e-05   8.54029308e-01 ...,   9.51094021e-03
    9.17649937e-02   3.19402643e-04]
 ..., 
 [  4.75519967e-05   1.31886628e-02   3.78600932e-03 ...,   9.44968594e-01
    8.02402988e-03   2.42171463e-02]
 [  1.20796132e-02   1.33345671e-04   3.28787135e-03 ...,   2.33875092e-04
    9.60474737e-01   2.10076763e-02]
 [  1.69544408e-03   3.19650130e-03   3.12861439e-03 ...,   1.37775469e-01
    7.23833217e-02   3.86564993e-01]]
[[  9.20438636e-01   7.52171140e-04   4.26498869e-03 ...,   2.21940776e-06
    5.02201630e-03   9.78611941e-06]
 [  2.69960225e-06   9.40919389e-01   5.96784441e-03 ...,   1.34163426e-05
    3.06173261e-02   1.77241654e-04]
 [  7.39577718e-03   4.41513952e-05   8.56660209e-01 ...,   9.27108667e-03
    9.00837710e-02   3.07780125e-04]
 ..., 
 [  4.62446623e-05   1.30036990e-02   3.74654380e-03 ...,   9.45574339e-01
    7.94968365e-03   2.39989819e-02]
 [  1.19868432e-02   1.30467445e-04   3.24981058e-03 ...,   2.29268764e-04
    9.60871801e-01   2.08056850e-02]
 [  1.68817039e-03   3.17634304e-03   3.09017314e-03 ...,   1.38004491e-01
    7.24289729e-02   3.87385591e-01]]
[[  9.20438636e-01   7.52171140e-04   4.26498869e-03 ...,   2.21940776e-06
    5.02201630e-03   9.78611941e-06]
 [  2.69960225e-06   9.40919389e-01   5.96784441e-03 ...,   1.34163426e-05
    3.06173261e-02   1.77241654e-04]
 [  7.39577718e-03   4.41513952e-05   8.56660209e-01 ...,   9.27108667e-03
    9.00837710e-02   3.07780125e-04]
 ..., 
 [  4.62446623e-05   1.30036990e-02   3.74654380e-03 ...,   9.45574339e-01
    7.94968365e-03   2.39989819e-02]
 [  1.19868432e-02   1.30467445e-04   3.24981058e-03 ...,   2.29268764e-04
    9.60871801e-01   2.08056850e-02]
 [  1.68817039e-03   3.17634304e-03   3.09017314e-03 ...,   1.38004491e-01
    7.24289729e-02   3.87385591e-01]]
[[  9.21054124e-01   7.41907206e-04   4.21691735e-03 ...,   2.12289968e-06
    4.97078473e-03   9.42962546e-06]
 [  2.55486686e-06   9.42336586e-01   5.82649262e-03 ...,   1.27173435e-05
    2.98936718e-02   1.69551361e-04]
 [  7.23701007e-03   4.25638571e-05   8.59224748e-01 ...,   9.03876805e-03
    8.84436137e-02   2.96679615e-04]
 ..., 
 [  4.49883399e-05   1.28234415e-02   3.70805809e-03 ...,   9.46164858e-01
    7.87717985e-03   2.37858416e-02]
 [  1.18963276e-02   1.27698057e-04   3.21278827e-03 ...,   2.24815169e-04
    9.61259209e-01   2.06079249e-02]
 [  1.68107901e-03   3.15663553e-03   3.05269479e-03 ...,   1.38229394e-01
    7.24733131e-02   3.88205232e-01]]
[[  9.21054124e-01   7.41907206e-04   4.21691735e-03 ...,   2.12289968e-06
    4.97078473e-03   9.42962546e-06]
 [  2.55486686e-06   9.42336586e-01   5.82649262e-03 ...,   1.27173435e-05
    2.98936718e-02   1.69551361e-04]
 [  7.23701007e-03   4.25638571e-05   8.59224748e-01 ...,   9.03876805e-03
    8.84436137e-02   2.96679615e-04]
 ..., 
 [  4.49883399e-05   1.28234415e-02   3.70805809e-03 ...,   9.46164858e-01
    7.87717985e-03   2.37858416e-02]
 [  1.18963276e-02   1.27698057e-04   3.21278827e-03 ...,   2.24815169e-04
    9.61259209e-01   2.06079249e-02]
 [  1.68107901e-03   3.15663553e-03   3.05269479e-03 ...,   1.38229394e-01
    7.24733131e-02   3.88205232e-01]]
[[  9.21658328e-01   7.31957267e-04   4.16995625e-03 ...,   2.03146730e-06
    4.92085601e-03   9.08948915e-06]
 [  2.41941335e-06   9.43704455e-01   5.69019419e-03 ...,   1.20615504e-05
    2.91951199e-02   1.62274499e-04]
 [  7.08306350e-03   4.10499087e-05   8.61724927e-01 ...,   8.81370458e-03
    8.68433848e-02   2.86073370e-04]
 ..., 
 [  4.37804541e-05   1.26477136e-02   3.67051376e-03 ...,   9.46740741e-01
    7.80644769e-03   2.35775368e-02]
 [  1.18079864e-02   1.25031870e-04   3.17676242e-03 ...,   2.20507275e-04
    9.61637315e-01   2.04142598e-02]
 [  1.67416250e-03   3.13736215e-03   3.01614200e-03 ...,   1.38450192e-01
    7.25163715e-02   3.89023958e-01]]
[[  9.21658328e-01   7.31957267e-04   4.16995625e-03 ...,   2.03146730e-06
    4.92085601e-03   9.08948915e-06]
 [  2.41941335e-06   9.43704455e-01   5.69019419e-03 ...,   1.20615504e-05
    2.91951199e-02   1.62274499e-04]
 [  7.08306350e-03   4.10499087e-05   8.61724927e-01 ...,   8.81370458e-03
    8.68433848e-02   2.86073370e-04]
 ..., 
 [  4.37804541e-05   1.26477136e-02   3.67051376e-03 ...,   9.46740741e-01
    7.80644769e-03   2.35775368e-02]
 [  1.18079864e-02   1.25031870e-04   3.17676242e-03 ...,   2.20507275e-04
    9.61637315e-01   2.04142598e-02]
 [  1.67416250e-03   3.13736215e-03   3.01614200e-03 ...,   1.38450192e-01
    7.25163715e-02   3.89023958e-01]]
[[  9.22251586e-01   7.22307525e-04   4.12406661e-03 ...,   1.94479502e-06
    4.87217934e-03   8.76480097e-06]
 [  2.29255490e-06   9.45025170e-01   5.55872092e-03 ...,   1.14458874e-05
    2.85205650e-02   1.55384815e-04]
 [  6.93375162e-03   3.96054259e-05   8.64162686e-01 ...,   8.59562833e-03
    8.52819766e-02   2.75935351e-04]
 ..., 
 [  4.26185886e-05   1.24763470e-02   3.63387434e-03 ...,   9.47302551e-01
    7.73741999e-03   2.33738882e-02]
 [  1.17217434e-02   1.22463615e-04   3.14169321e-03 ...,   2.16338463e-04
    9.62006459e-01   2.02245593e-02]
 [  1.66741378e-03   3.11850711e-03   2.98047931e-03 ...,   1.38666905e-01
    7.25581763e-02   3.89841805e-01]]
[[  9.22251586e-01   7.22307525e-04   4.12406661e-03 ...,   1.94479502e-06
    4.87217934e-03   8.76480097e-06]
 [  2.29255490e-06   9.45025170e-01   5.55872092e-03 ...,   1.14458874e-05
    2.85205650e-02   1.55384815e-04]
 [  6.93375162e-03   3.96054259e-05   8.64162686e-01 ...,   8.59562833e-03
    8.52819766e-02   2.75935351e-04]
 ..., 
 [  4.26185886e-05   1.24763470e-02   3.63387434e-03 ...,   9.47302551e-01
    7.73741999e-03   2.33738882e-02]
 [  1.17217434e-02   1.22463615e-04   3.14169321e-03 ...,   2.16338463e-04
    9.62006459e-01   2.02245593e-02]
 [  1.66741378e-03   3.11850711e-03   2.98047931e-03 ...,   1.38666905e-01
    7.25581763e-02   3.89841805e-01]]
[[  9.22834223e-01   7.12944964e-04   4.07921147e-03 ...,   1.86259004e-06
    4.82470659e-03   8.45471102e-06]
 [  2.17366197e-06   9.46300796e-01   5.43185682e-03 ...,   1.08675258e-05
    2.78689592e-02   1.48857965e-04]
 [  6.78889718e-03   3.82265544e-05   8.66539897e-01 ...,   8.38428267e-03
    8.37583110e-02   2.66241097e-04]
 ..., 
 [  4.15004743e-05   1.23091819e-02   3.59810522e-03 ...,   9.47850818e-01
    7.67003288e-03   2.31747254e-02]
 [  1.16375261e-02   1.19988355e-04   3.10754292e-03 ...,   2.12302495e-04
    9.62366959e-01   2.00386988e-02]
 [  1.66082617e-03   3.10005538e-03   2.94567307e-03 ...,   1.38879551e-01
    7.25987542e-02   3.90658808e-01]]
[[  9.22834223e-01   7.12944964e-04   4.07921147e-03 ...,   1.86259004e-06
    4.82470659e-03   8.45471102e-06]
 [  2.17366197e-06   9.46300796e-01   5.43185682e-03 ...,   1.08675258e-05
    2.78689592e-02   1.48857965e-04]
 [  6.78889718e-03   3.82265544e-05   8.66539897e-01 ...,   8.38428267e-03
    8.37583110e-02   2.66241097e-04]
 ..., 
 [  4.15004743e-05   1.23091819e-02   3.59810522e-03 ...,   9.47850818e-01
    7.67003288e-03   2.31747254e-02]
 [  1.16375261e-02   1.19988355e-04   3.10754292e-03 ...,   2.12302495e-04
    9.62366959e-01   2.00386988e-02]
 [  1.66082617e-03   3.10005538e-03   2.94567307e-03 ...,   1.38879551e-01
    7.25987542e-02   3.90658808e-01]]
[[  9.23406548e-01   7.03857293e-04   4.03535559e-03 ...,   1.78458040e-06
    4.77839207e-03   8.15842454e-06]
 [  2.06215698e-06   9.47533287e-01   5.30939728e-03 ...,   1.03238613e-05
    2.72393082e-02   1.42671358e-04]
 [  6.64833105e-03   3.69096892e-05   8.68858375e-01 ...,   8.17942172e-03
    8.22713390e-02   2.56967622e-04]
 ..., 
 [  4.04239790e-05   1.21460661e-02   3.56317357e-03 ...,   9.48386049e-01
    7.60422562e-03   2.29798862e-02]
 [  1.15552652e-02   1.17601466e-04   3.07427576e-03 ...,   2.08393489e-04
    9.62719123e-01   1.98565585e-02]
 [  1.65439327e-03   3.08199268e-03   2.91169130e-03 ...,   1.39088154e-01
    7.26381309e-02   3.91474999e-01]]
[[  9.23406548e-01   7.03857293e-04   4.03535559e-03 ...,   1.78458040e-06
    4.77839207e-03   8.15842454e-06]
 [  2.06215698e-06   9.47533287e-01   5.30939728e-03 ...,   1.03238613e-05
    2.72393082e-02   1.42671358e-04]
 [  6.64833105e-03   3.69096892e-05   8.68858375e-01 ...,   8.17942172e-03
    8.22713390e-02   2.56967622e-04]
 ..., 
 [  4.04239790e-05   1.21460661e-02   3.56317357e-03 ...,   9.48386049e-01
    7.60422562e-03   2.29798862e-02]
 [  1.15552652e-02   1.17601466e-04   3.07427576e-03 ...,   2.08393489e-04
    9.62719123e-01   1.98565585e-02]
 [  1.65439327e-03   3.08199268e-03   2.91169130e-03 ...,   1.39088154e-01
    7.26381309e-02   3.91474999e-01]]
[[  9.23968860e-01   6.95032897e-04   3.99246535e-03 ...,   1.71051333e-06
    4.73319239e-03   7.87519774e-06]
 [  1.95750957e-06   9.48724499e-01   5.19114849e-03 ...,   9.81249519e-06
    2.66306689e-02   1.36804014e-04]
 [  6.51189180e-03   3.56514564e-05   8.71119872e-01 ...,   7.98080987e-03
    8.08200400e-02   2.48093314e-04]
 ..., 
 [  3.93870974e-05   1.19868543e-02   3.52904817e-03 ...,   9.48908726e-01
    7.53994045e-03   2.27892165e-02]
 [  1.14748945e-02   1.15298610e-04   3.04185776e-03 ...,   2.04605894e-04
    9.63063242e-01   1.96780242e-02]
 [  1.64810902e-03   3.06430536e-03   2.87850358e-03 ...,   1.39292737e-01
    7.26763309e-02   3.92290409e-01]]
[[  9.23968860e-01   6.95032897e-04   3.99246535e-03 ...,   1.71051333e-06
    4.73319239e-03   7.87519774e-06]
 [  1.95750957e-06   9.48724499e-01   5.19114849e-03 ...,   9.81249519e-06
    2.66306689e-02   1.36804014e-04]
 [  6.51189180e-03   3.56514564e-05   8.71119872e-01 ...,   7.98080987e-03
    8.08200400e-02   2.48093314e-04]
 ..., 
 [  3.93870974e-05   1.19868543e-02   3.52904817e-03 ...,   9.48908726e-01
    7.53994045e-03   2.27892165e-02]
 [  1.14748945e-02   1.15298610e-04   3.04185776e-03 ...,   2.04605894e-04
    9.63063242e-01   1.96780242e-02]
 [  1.64810902e-03   3.06430536e-03   2.87850358e-03 ...,   1.39292737e-01
    7.26763309e-02   3.92290409e-01]]
[[  9.24521441e-01   6.86460793e-04   3.95050865e-03 ...,   1.64015368e-06
    4.68906635e-03   7.60433404e-06]
 [  1.85923231e-06   9.49876192e-01   5.07692672e-03 ...,   9.33121541e-06
    2.60421460e-02   1.31236437e-04]
 [  6.37942532e-03   3.44486965e-05   8.73326084e-01 ...,   7.78822129e-03
    7.94034219e-02   2.39597839e-04]
 ..., 
 [  3.83879427e-05   1.18314086e-02   3.49569935e-03 ...,   9.49419305e-01
    7.47712237e-03   2.26025691e-02]
 [  1.13963509e-02   1.13075718e-04   3.01025666e-03 ...,   2.00934468e-04
    9.63399593e-01   1.95029861e-02]
 [  1.64196767e-03   3.04698046e-03   2.84608099e-03 ...,   1.39493326e-01
    7.27133779e-02   3.93105064e-01]]
[[  9.24521441e-01   6.86460793e-04   3.95050865e-03 ...,   1.64015368e-06
    4.68906635e-03   7.60433404e-06]
 [  1.85923231e-06   9.49876192e-01   5.07692672e-03 ...,   9.33121541e-06
    2.60421460e-02   1.31236437e-04]
 [  6.37942532e-03   3.44486965e-05   8.73326084e-01 ...,   7.78822129e-03
    7.94034219e-02   2.39597839e-04]
 ..., 
 [  3.83879427e-05   1.18314086e-02   3.49569935e-03 ...,   9.49419305e-01
    7.47712237e-03   2.26025691e-02]
 [  1.13963509e-02   1.13075718e-04   3.01025666e-03 ...,   2.00934468e-04
    9.63399593e-01   1.95029861e-02]
 [  1.64196767e-03   3.04698046e-03   2.84608099e-03 ...,   1.39493326e-01
    7.27133779e-02   3.93105064e-01]]
[[  9.25064566e-01   6.78130590e-04   3.90945483e-03 ...,   1.57328258e-06
    4.64597475e-03   7.34518063e-06]
 [  1.76687686e-06   9.50990038e-01   4.96655775e-03 ...,   8.87798107e-06
    2.54728895e-02   1.25950495e-04]
 [  6.25078437e-03   3.32984484e-05   8.75478651e-01 ...,   7.60143947e-03
    7.80205201e-02   2.31462055e-04]
 ..., 
 [  3.74247377e-05   1.16795970e-02   3.46309888e-03 ...,   9.49918223e-01
    7.41571899e-03   2.24198040e-02]
 [  1.13195738e-02   1.10928964e-04   2.97944180e-03 ...,   1.97374257e-04
    9.63728441e-01   1.93313389e-02]
 [  1.63596372e-03   3.03000559e-03   2.81439600e-03 ...,   1.39689949e-01
    7.27492942e-02   3.93918991e-01]]
[[  9.25064566e-01   6.78130590e-04   3.90945483e-03 ...,   1.57328258e-06
    4.64597475e-03   7.34518063e-06]
 [  1.76687686e-06   9.50990038e-01   4.96655775e-03 ...,   8.87798107e-06
    2.54728895e-02   1.25950495e-04]
 [  6.25078437e-03   3.32984484e-05   8.75478651e-01 ...,   7.60143947e-03
    7.80205201e-02   2.31462055e-04]
 ..., 
 [  3.74247377e-05   1.16795970e-02   3.46309888e-03 ...,   9.49918223e-01
    7.41571899e-03   2.24198040e-02]
 [  1.13195738e-02   1.10928964e-04   2.97944180e-03 ...,   1.97374257e-04
    9.63728441e-01   1.93313389e-02]
 [  1.63596372e-03   3.03000559e-03   2.81439600e-03 ...,   1.39689949e-01
    7.27492942e-02   3.93918991e-01]]
[[  9.25598495e-01   6.70032448e-04   3.86927457e-03 ...,   1.50969606e-06
    4.60388033e-03   7.09712527e-06]
 [  1.68003050e-06   9.52067623e-01   4.85987629e-03 ...,   8.45090743e-06
    2.49220916e-02   1.20929314e-04]
 [  6.12582831e-03   3.21979355e-05   8.77579158e-01 ...,   7.42025680e-03
    7.66703974e-02   2.23667938e-04]
 ..., 
 [  3.64958079e-05   1.15312938e-02   3.43121989e-03 ...,   9.50405895e-01
    7.35568037e-03   2.22407879e-02]
 [  1.12445055e-02   1.08854754e-04   2.94938402e-03 ...,   1.93920576e-04
    9.64050039e-01   1.91629817e-02]
 [  1.63009193e-03   3.01336893e-03   2.78342236e-03 ...,   1.39882634e-01
    7.27841016e-02   3.94732212e-01]]
[[  9.25598495e-01   6.70032448e-04   3.86927457e-03 ...,   1.50969606e-06
    4.60388033e-03   7.09712527e-06]
 [  1.68003050e-06   9.52067623e-01   4.85987629e-03 ...,   8.45090743e-06
    2.49220916e-02   1.20929314e-04]
 [  6.12582831e-03   3.21979355e-05   8.77579158e-01 ...,   7.42025680e-03
    7.66703974e-02   2.23667938e-04]
 ..., 
 [  3.64958079e-05   1.15312938e-02   3.43121989e-03 ...,   9.50405895e-01
    7.35568037e-03   2.22407879e-02]
 [  1.12445055e-02   1.08854754e-04   2.94938402e-03 ...,   1.93920576e-04
    9.64050039e-01   1.91629817e-02]
 [  1.63009193e-03   3.01336893e-03   2.78342236e-03 ...,   1.39882634e-01
    7.27841016e-02   3.94732212e-01]]
[[  9.26123480e-01   6.62157042e-04   3.82993985e-03 ...,   1.44920400e-06
    4.56274761e-03   6.85959342e-06]
 [  1.59831297e-06   9.53110456e-01   4.75672549e-03 ...,   8.04825275e-06
    2.43889852e-02   1.16157179e-04]
 [  6.00442267e-03   3.11445528e-05   8.79629138e-01 ...,   7.24447416e-03
    7.53521433e-02   2.16198502e-04]
 ..., 
 [  3.55995740e-05   1.13863789e-02   3.40003681e-03 ...,   9.50882716e-01
    7.29695889e-03   2.20653932e-02]
 [  1.11710908e-02   1.06849706e-04   2.92005556e-03 ...,   1.90568990e-04
    9.64364630e-01   1.89978174e-02]
 [  1.62434734e-03   2.99705922e-03   2.75313509e-03 ...,   1.40071410e-01
    7.28178207e-02   3.95544750e-01]]
[[  9.26123480e-01   6.62157042e-04   3.82993985e-03 ...,   1.44920400e-06
    4.56274761e-03   6.85959342e-06]
 [  1.59831297e-06   9.53110456e-01   4.75672549e-03 ...,   8.04825275e-06
    2.43889852e-02   1.16157179e-04]
 [  6.00442267e-03   3.11445528e-05   8.79629138e-01 ...,   7.24447416e-03
    7.53521433e-02   2.16198502e-04]
 ..., 
 [  3.55995740e-05   1.13863789e-02   3.40003681e-03 ...,   9.50882716e-01
    7.29695889e-03   2.20653932e-02]
 [  1.11710908e-02   1.06849706e-04   2.92005556e-03 ...,   1.90568990e-04
    9.64364630e-01   1.89978174e-02]
 [  1.62434734e-03   2.99705922e-03   2.75313509e-03 ...,   1.40071410e-01
    7.28178207e-02   3.95544750e-01]]
[[  9.26639762e-01   6.54495531e-04   3.79142385e-03 ...,   1.39162898e-06
    4.52254278e-03   6.63204552e-06]
 [  1.52137364e-06   9.54119970e-01   4.65695641e-03 ...,   7.66840618e-06
    2.38728406e-02   1.11619448e-04]
 [  5.88643891e-03   3.01358543e-05   8.81630076e-01 ...,   7.07390055e-03
    7.40648733e-02   2.09037735e-04]
 ..., 
 [  3.47345459e-05   1.12447377e-02   3.36952524e-03 ...,   9.51349063e-01
    7.23950913e-03   2.18934984e-02]
 [  1.10992767e-02   1.04910636e-04   2.89143002e-03 ...,   1.87315301e-04
    9.64672443e-01   1.88357531e-02]
 [  1.61872518e-03   2.98106568e-03   2.72351034e-03 ...,   1.40256310e-01
    7.28504715e-02   3.96356624e-01]]
[[  9.26639762e-01   6.54495531e-04   3.79142385e-03 ...,   1.39162898e-06
    4.52254278e-03   6.63204552e-06]
 [  1.52137364e-06   9.54119970e-01   4.65695641e-03 ...,   7.66840618e-06
    2.38728406e-02   1.11619448e-04]
 [  5.88643891e-03   3.01358543e-05   8.81630076e-01 ...,   7.07390055e-03
    7.40648733e-02   2.09037735e-04]
 ..., 
 [  3.47345459e-05   1.12447377e-02   3.36952524e-03 ...,   9.51349063e-01
    7.23950913e-03   2.18934984e-02]
 [  1.10992767e-02   1.04910636e-04   2.89143002e-03 ...,   1.87315301e-04
    9.64672443e-01   1.88357531e-02]
 [  1.61872518e-03   2.98106568e-03   2.72351034e-03 ...,   1.40256310e-01
    7.28504715e-02   3.96356624e-01]]
[[  9.27147573e-01   6.47039528e-04   3.75370088e-03 ...,   1.33680535e-06
    4.48323364e-03   6.41397456e-06]
 [  1.44888896e-06   9.55097528e-01   4.56042760e-03 ...,   7.30987688e-06
    2.33729642e-02   1.07302465e-04]
 [  5.77175406e-03   2.91695424e-05   8.83583405e-01 ...,   6.90835268e-03
    7.28077285e-02   2.02170535e-04]
 ..., 
 [  3.38993165e-05   1.11062607e-02   3.33966194e-03 ...,   9.51805297e-01
    7.18328771e-03   2.17249875e-02]
 [  1.10290126e-02   1.03034543e-04   2.86348223e-03 ...,   1.84155529e-04
    9.64973699e-01   1.86766992e-02]
 [  1.61322093e-03   2.96537802e-03   2.69452539e-03 ...,   1.40437364e-01
    7.28820731e-02   3.97167853e-01]]
[[  9.27147573e-01   6.47039528e-04   3.75370088e-03 ...,   1.33680535e-06
    4.48323364e-03   6.41397456e-06]
 [  1.44888896e-06   9.55097528e-01   4.56042760e-03 ...,   7.30987688e-06
    2.33729642e-02   1.07302465e-04]
 [  5.77175406e-03   2.91695424e-05   8.83583405e-01 ...,   6.90835268e-03
    7.28077285e-02   2.02170535e-04]
 ..., 
 [  3.38993165e-05   1.11062607e-02   3.33966194e-03 ...,   9.51805297e-01
    7.18328771e-03   2.17249875e-02]
 [  1.10290126e-02   1.03034543e-04   2.86348223e-03 ...,   1.84155529e-04
    9.64973699e-01   1.86766992e-02]
 [  1.61322093e-03   2.96537802e-03   2.69452539e-03 ...,   1.40437364e-01
    7.28820731e-02   3.97167853e-01]]
[[  9.27647134e-01   6.39781069e-04   3.71674637e-03 ...,   1.28457834e-06
    4.44478948e-03   6.20490380e-06]
 [  1.38056015e-06   9.56044427e-01   4.46700464e-03 ...,   6.97128404e-06
    2.28886961e-02   1.03193489e-04]
 [  5.66025048e-03   2.82434573e-05   8.85490511e-01 ...,   6.74765466e-03
    7.15798752e-02   1.95582652e-04]
 ..., 
 [  3.30925565e-05   1.09708430e-02   3.31042475e-03 ...,   9.52251761e-01
    7.12825320e-03   2.15597494e-02]
 [  1.09602499e-02   1.01218599e-04   2.83618820e-03 ...,   1.81085900e-04
    9.65268609e-01   1.85205698e-02]
 [  1.60783026e-03   2.94998639e-03   2.66615852e-03 ...,   1.40614605e-01
    7.29126437e-02   3.97978454e-01]]
[[  9.27647134e-01   6.39781069e-04   3.71674637e-03 ...,   1.28457834e-06
    4.44478948e-03   6.20490380e-06]
 [  1.38056015e-06   9.56044427e-01   4.46700464e-03 ...,   6.97128404e-06
    2.28886961e-02   1.03193489e-04]
 [  5.66025048e-03   2.82434573e-05   8.85490511e-01 ...,   6.74765466e-03
    7.15798752e-02   1.95582652e-04]
 ..., 
 [  3.30925565e-05   1.09708430e-02   3.31042475e-03 ...,   9.52251761e-01
    7.12825320e-03   2.15597494e-02]
 [  1.09602499e-02   1.01218599e-04   2.83618820e-03 ...,   1.81085900e-04
    9.65268609e-01   1.85205698e-02]
 [  1.60783026e-03   2.94998639e-03   2.66615852e-03 ...,   1.40614605e-01
    7.29126437e-02   3.97978454e-01]]
[[  9.28138662e-01   6.32712589e-04   3.68053672e-03 ...,   1.23480324e-06
    4.40718100e-03   6.00438471e-06]
 [  1.31611105e-06   9.56961898e-01   4.37655976e-03 ...,   6.65134788e-06
    2.24194083e-02   9.92806246e-05]
 [  5.55181556e-03   2.73555678e-05   8.87352738e-01 ...,   6.59163767e-03
    7.03805037e-02   1.89260630e-04]
 ..., 
 [  3.23130091e-05   1.08383845e-02   3.28179248e-03 ...,   9.52688783e-01
    7.07436603e-03   2.13976783e-02]
 [  1.08929420e-02   9.94601330e-05   2.80952504e-03 ...,   1.78102836e-04
    9.65557376e-01   1.83672822e-02]
 [  1.60254905e-03   2.93488139e-03   2.63838901e-03 ...,   1.40788068e-01
    7.29422011e-02   3.98788441e-01]]
[[  9.28138662e-01   6.32712589e-04   3.68053672e-03 ...,   1.23480324e-06
    4.40718100e-03   6.00438471e-06]
 [  1.31611105e-06   9.56961898e-01   4.37655976e-03 ...,   6.65134788e-06
    2.24194083e-02   9.92806246e-05]
 [  5.55181556e-03   2.73555678e-05   8.87352738e-01 ...,   6.59163767e-03
    7.03805037e-02   1.89260630e-04]
 ..., 
 [  3.23130091e-05   1.08383845e-02   3.28179248e-03 ...,   9.52688783e-01
    7.07436603e-03   2.13976783e-02]
 [  1.08929420e-02   9.94601330e-05   2.80952504e-03 ...,   1.78102836e-04
    9.65557376e-01   1.83672822e-02]
 [  1.60254905e-03   2.93488139e-03   2.63838901e-03 ...,   1.40788068e-01
    7.29422011e-02   3.98788441e-01]]
[[  9.28622361e-01   6.25826899e-04   3.64504935e-03 ...,   1.18734465e-06
    4.37038022e-03   5.81199504e-06]
 [  1.25528627e-06   9.57851118e-01   4.28897143e-03 ...,   6.34888145e-06
    2.19645028e-02   9.55527561e-05]
 [  5.44634150e-03   2.65039626e-05   8.89171382e-01 ...,   6.44013959e-03
    6.92088283e-02   1.83191764e-04]
 ..., 
 [  3.15594855e-05   1.07087894e-02   3.25374492e-03 ...,   9.53116677e-01
    7.02158833e-03   2.12386728e-02]
 [  1.08270442e-02   9.77566261e-05   2.78347094e-03 ...,   1.75202936e-04
    9.65840193e-01   1.82167568e-02]
 [  1.59737336e-03   2.92005400e-03   2.61119705e-03 ...,   1.40957786e-01
    7.29707623e-02   3.99597829e-01]]
[[  9.28622361e-01   6.25826899e-04   3.64504935e-03 ...,   1.18734465e-06
    4.37038022e-03   5.81199504e-06]
 [  1.25528627e-06   9.57851118e-01   4.28897143e-03 ...,   6.34888145e-06
    2.19645028e-02   9.55527561e-05]
 [  5.44634150e-03   2.65039626e-05   8.89171382e-01 ...,   6.44013959e-03
    6.92088283e-02   1.83191764e-04]
 ..., 
 [  3.15594855e-05   1.07087894e-02   3.25374492e-03 ...,   9.53116677e-01
    7.02158833e-03   2.12386728e-02]
 [  1.08270442e-02   9.77566261e-05   2.78347094e-03 ...,   1.75202936e-04
    9.65840193e-01   1.82167568e-02]
 [  1.59737336e-03   2.92005400e-03   2.61119705e-03 ...,   1.40957786e-01
    7.29707623e-02   3.99597829e-01]]
[[  9.29098430e-01   6.19117160e-04   3.61026257e-03 ...,   1.14207581e-06
    4.33436042e-03   5.62733703e-06]
 [  1.19784942e-06   9.58713204e-01   4.20412408e-03 ...,   6.06278311e-06
    2.15234104e-02   9.19994939e-05]
 [  5.34372505e-03   2.56868421e-05   8.90947699e-01 ...,   6.29300478e-03
    6.80640866e-02   1.77364044e-04]
 ..., 
 [  3.08308603e-05   1.05819657e-02   3.22626278e-03 ...,   9.53535743e-01
    6.96988392e-03   2.10826357e-02]
 [  1.07625139e-02   9.61056964e-05   2.75800504e-03 ...,   1.72382971e-04
    9.66117245e-01   1.80689171e-02]
 [  1.59229940e-03   2.90549559e-03   2.58456370e-03 ...,   1.41123793e-01
    7.29983435e-02   4.00406630e-01]]
[[  9.29098430e-01   6.19117160e-04   3.61026257e-03 ...,   1.14207581e-06
    4.33436042e-03   5.62733703e-06]
 [  1.19784942e-06   9.58713204e-01   4.20412408e-03 ...,   6.06278311e-06
    2.15234104e-02   9.19994939e-05]
 [  5.34372505e-03   2.56868421e-05   8.90947699e-01 ...,   6.29300478e-03
    6.80640866e-02   1.77364044e-04]
 ..., 
 [  3.08308603e-05   1.05819657e-02   3.22626278e-03 ...,   9.53535743e-01
    6.96988392e-03   2.10826357e-02]
 [  1.07625139e-02   9.61056964e-05   2.75800504e-03 ...,   1.72382971e-04
    9.66117245e-01   1.80689171e-02]
 [  1.59229940e-03   2.90549559e-03   2.58456370e-03 ...,   1.41123793e-01
    7.29983435e-02   4.00406630e-01]]
[[  9.29567062e-01   6.12576865e-04   3.57615558e-03 ...,   1.09887798e-06
    4.29909607e-03   5.45003579e-06]
 [  1.14358155e-06   9.59549222e-01   4.12190767e-03 ...,   5.79202972e-06
    2.10955886e-02   8.86111189e-05]
 [  5.24386730e-03   2.49025107e-05   8.92682902e-01 ...,   6.15008373e-03
    6.69455384e-02   1.71766121e-04]
 ..., 
 [  3.01260680e-05   1.04578256e-02   3.19932758e-03 ...,   9.53946266e-01
    6.91921813e-03   2.09294742e-02]
 [  1.06993097e-02   9.45050926e-05   2.73310744e-03 ...,   1.69639873e-04
    9.66388710e-01   1.79236894e-02]
 [  1.58732359e-03   2.89119791e-03   2.55847087e-03 ...,   1.41286127e-01
    7.30249606e-02   4.01214856e-01]]
[[  9.29567062e-01   6.12576865e-04   3.57615558e-03 ...,   1.09887798e-06
    4.29909607e-03   5.45003579e-06]
 [  1.14358155e-06   9.59549222e-01   4.12190767e-03 ...,   5.79202972e-06
    2.10955886e-02   8.86111189e-05]
 [  5.24386730e-03   2.49025107e-05   8.92682902e-01 ...,   6.15008373e-03
    6.69455384e-02   1.71766121e-04]
 ..., 
 [  3.01260680e-05   1.04578256e-02   3.19932758e-03 ...,   9.53946266e-01
    6.91921813e-03   2.09294742e-02]
 [  1.06993097e-02   9.45050926e-05   2.73310744e-03 ...,   1.69639873e-04
    9.66388710e-01   1.79236894e-02]
 [  1.58732359e-03   2.89119791e-03   2.55847087e-03 ...,   1.41286127e-01
    7.30249606e-02   4.01214856e-01]]
[[  9.30028439e-01   6.06199818e-04   3.54270838e-03 ...,   1.05763983e-06
    4.26456275e-03   5.27973778e-06]
 [  1.09227973e-06   9.60360185e-01   4.04221749e-03 ...,   5.53567046e-06
    2.06805204e-02   8.53785347e-05]
 [  5.14667345e-03   2.41493707e-05   8.94378167e-01 ...,   6.01123280e-03
    6.58524657e-02   1.66387257e-04]
 ..., 
 [  2.94440987e-05   1.03362848e-02   3.17292168e-03 ...,   9.54348522e-01
    6.86955780e-03   2.07790994e-02]
 [  1.06373923e-02   9.29526846e-05   2.70875911e-03 ...,   1.66970722e-04
    9.66654758e-01   1.77810026e-02]
 [  1.58244248e-03   2.87715303e-03   2.53290121e-03 ...,   1.41444821e-01
    7.30506287e-02   4.02022517e-01]]
[[  9.30028439e-01   6.06199818e-04   3.54270838e-03 ...,   1.05763983e-06
    4.26456275e-03   5.27973778e-06]
 [  1.09227973e-06   9.60360185e-01   4.04221749e-03 ...,   5.53567046e-06
    2.06805204e-02   8.53785347e-05]
 [  5.14667345e-03   2.41493707e-05   8.94378167e-01 ...,   6.01123280e-03
    6.58524657e-02   1.66387257e-04]
 ..., 
 [  2.94440987e-05   1.03362848e-02   3.17292168e-03 ...,   9.54348522e-01
    6.86955780e-03   2.07790994e-02]
 [  1.06373923e-02   9.29526846e-05   2.70875911e-03 ...,   1.66970722e-04
    9.66654758e-01   1.77810026e-02]
 [  1.58244248e-03   2.87715303e-03   2.53290121e-03 ...,   1.41444821e-01
    7.30506287e-02   4.02022517e-01]]
[[  9.30482740e-01   5.99980115e-04   3.50990180e-03 ...,   1.01825697e-06
    4.23073711e-03   5.11610940e-06]
 [  1.04375573e-06   9.61147063e-01   3.96495376e-03 ...,   5.29282108e-06
    2.02777131e-02   8.22932221e-05]
 [  5.05205263e-03   2.34259150e-05   8.96034628e-01 ...,   5.87631400e-03
    6.47841719e-02   1.61217296e-04]
 ..., 
 [  2.87839950e-05   1.02172625e-02   3.14702817e-03 ...,   9.54742773e-01
    6.82087115e-03   2.06314261e-02]
 [  1.05767237e-02   9.14464559e-05   2.68494185e-03 ...,   1.64372740e-04
    9.66915552e-01   1.76407884e-02]
 [  1.57765276e-03   2.86335335e-03   2.50783814e-03 ...,   1.41599912e-01
    7.30753624e-02   4.02829621e-01]]
[[  9.30482740e-01   5.99980115e-04   3.50990180e-03 ...,   1.01825697e-06
    4.23073711e-03   5.11610940e-06]
 [  1.04375573e-06   9.61147063e-01   3.96495376e-03 ...,   5.29282108e-06
    2.02777131e-02   8.22932221e-05]
 [  5.05205263e-03   2.34259150e-05   8.96034628e-01 ...,   5.87631400e-03
    6.47841719e-02   1.61217296e-04]
 ..., 
 [  2.87839950e-05   1.02172625e-02   3.14702817e-03 ...,   9.54742773e-01
    6.82087115e-03   2.06314261e-02]
 [  1.05767237e-02   9.14464559e-05   2.68494185e-03 ...,   1.64372740e-04
    9.66915552e-01   1.76407884e-02]
 [  1.57765276e-03   2.86335335e-03   2.50783814e-03 ...,   1.41599912e-01
    7.30753624e-02   4.02829621e-01]]
[[  9.30930136e-01   5.93912130e-04   3.47771739e-03 ...,   9.80631391e-07
    4.19759678e-03   4.95883574e-06]
 [  9.97834840e-07   9.61910778e-01   3.89002145e-03 ...,   5.06265877e-06
    1.98866967e-02   7.93471985e-05]
 [  4.95991772e-03   2.27307219e-05   8.97653386e-01 ...,   5.74519469e-03
    6.37399810e-02   1.56246621e-04]
 ..., 
 [  2.81448486e-05   1.01006812e-02   3.12163089e-03 ...,   9.55129271e-01
    6.77312773e-03   2.04863726e-02]
 [  1.05172675e-02   8.99844964e-05   2.66163826e-03 ...,   1.61843283e-04
    9.67171250e-01   1.75029809e-02]
 [  1.57295129e-03   2.84979159e-03   2.48326578e-03 ...,   1.41751437e-01
    7.30991760e-02   4.03636179e-01]]
[[  9.30930136e-01   5.93912130e-04   3.47771739e-03 ...,   9.80631391e-07
    4.19759678e-03   4.95883574e-06]
 [  9.97834840e-07   9.61910778e-01   3.89002145e-03 ...,   5.06265877e-06
    1.98866967e-02   7.93471985e-05]
 [  4.95991772e-03   2.27307219e-05   8.97653386e-01 ...,   5.74519469e-03
    6.37399810e-02   1.56246621e-04]
 ..., 
 [  2.81448486e-05   1.01006812e-02   3.12163089e-03 ...,   9.55129271e-01
    6.77312773e-03   2.04863726e-02]
 [  1.05172675e-02   8.99844964e-05   2.66163826e-03 ...,   1.61843283e-04
    9.67171250e-01   1.75029809e-02]
 [  1.57295129e-03   2.84979159e-03   2.48326578e-03 ...,   1.41751437e-01
    7.30991760e-02   4.03636179e-01]]
[[  9.31370794e-01   5.87990498e-04   3.44613740e-03 ...,   9.44671079e-07
    4.16512035e-03   4.80761931e-06]
 [  9.54354803e-07   9.62652211e-01   3.81732997e-03 ...,   4.84441740e-06
    1.95070227e-02   7.65329796e-05]
 [  4.87018513e-03   2.20624491e-05   8.99235505e-01 ...,   5.61774740e-03
    6.27192374e-02   1.51466128e-04]
 ..., 
 [  2.75257976e-05   9.98646668e-03   3.09671435e-03 ...,   9.55508257e-01
    6.72629835e-03   2.03438605e-02]
 [  1.04589885e-02   8.85649958e-05   2.63883169e-03 ...,   1.59379832e-04
    9.67422002e-01   1.73675164e-02]
 [  1.56833503e-03   2.83646076e-03   2.45916890e-03 ...,   1.41899433e-01
    7.31220831e-02   4.04442195e-01]]
[[  9.31370794e-01   5.87990498e-04   3.44613740e-03 ...,   9.44671079e-07
    4.16512035e-03   4.80761931e-06]
 [  9.54354803e-07   9.62652211e-01   3.81732997e-03 ...,   4.84441740e-06
    1.95070227e-02   7.65329796e-05]
 [  4.87018513e-03   2.20624491e-05   8.99235505e-01 ...,   5.61774740e-03
    6.27192374e-02   1.51466128e-04]
 ..., 
 [  2.75257976e-05   9.98646668e-03   3.09671435e-03 ...,   9.55508257e-01
    6.72629835e-03   2.03438605e-02]
 [  1.04589885e-02   8.85649958e-05   2.63883169e-03 ...,   1.59379832e-04
    9.67422002e-01   1.73675164e-02]
 [  1.56833503e-03   2.83646076e-03   2.45916890e-03 ...,   1.41899433e-01
    7.31220831e-02   4.04442195e-01]]
[[  9.31804872e-01   5.82210098e-04   3.41514480e-03 ...,   9.10289565e-07
    4.13328733e-03   4.66217897e-06]
 [  9.13164815e-07   9.63372201e-01   3.74679295e-03 ...,   4.63738315e-06
    1.91382634e-02   7.38435441e-05]
 [  4.78277467e-03   2.14198290e-05   9.00782012e-01 ...,   5.49384954e-03
    6.17213050e-02   1.46867190e-04]
 ..., 
 [  2.69260235e-05   9.87454746e-03   3.07226372e-03 ...,   9.55879962e-01
    6.68035501e-03   2.02038147e-02]
 [  1.04018531e-02   8.71862371e-05   2.61650618e-03 ...,   1.56979984e-04
    9.67667953e-01   1.72343337e-02]
 [  1.56380110e-03   2.82335415e-03   2.43553291e-03 ...,   1.42043936e-01
    7.31440968e-02   4.05247678e-01]]
Out[17]:
[<matplotlib.lines.Line2D at 0x7fb4f4137b10>]

y para probarlo vamos a aprender a clasificar a los digitos de nuestra base de datos


In [29]:
theta = 0.1 * (np.random.random((n + 1, K)) - 0.5)
theta, e_hist = dg_softmax_lotes(theta, extendida(x), y, alpha=alfita, max_epoch=1000)

print "El costo de la solución final es de ", costo(theta, extendida(x), y)

y_estimada = predice(theta, extendida(x))

errores = np.where(y.argmax(axis=1) == y_estimada.argmax(axis=1), 0, 1)

print "\nLos datos utilizados para el aprendizaje mal clasificados son el ", 100 * errores.mean(),"%"

# Esto solo es para hacerla más emocionante
x_test = data['X_valida']
y_test = data['T_valida']
y_estimada_T = predice(theta, extendida(x_test))
errores = np.where(y_test.argmax(axis=1) == y_estimada_T.argmax(axis=1), 0, 1)

print "\nY con los datos de pureba el error es del ", 100 * errores.mean(),"%"


El costo de la solución final es de  0.18505383444

Los datos utilizados para el aprendizaje mal clasificados son el  4.51111111111 %

Y con los datos de pureba el error es del  6.2 %

¿Será esta la mejor solución? ¿Será una buena solución?

2. Regresión logística "Uno contra todos"

Otra manera de resolver este problema es el utilizar la noción de "Uno contra todos", esto es, que cada una de las clases sea considerada en si como una única regresión logística. De esta manera, se intenta resolver en forma independiente $K$ regresiones logísticas, y por lo tanto se obtienen $K$ vectores $\theta_c$, uno por cada clase.

Claro que realizar $K$ regresiones logísticas en forma secuencial no es la forma más eficiente de resolver el problema, ya que se pueden ir realizando todas de forma simultanea. Para este caso vamos a definor una matriz $\theta$ similar a la matriz $\theta$ utilizada en softmax, así como el vector $z^{(i)}$ como el vector de las $K$ combinaciones lineales de las características con los parámetros de cada clase.

Lo que cambia fundamentalmente es la forma en que se calcula $\hat{y}^{(i)}_c$ el cual es ahora la probabilidad de que un objeto pertenezca a la clase $c$ en relación a no pertenecer,

$$y^{(i)}_c = g(z_c^{(i)}) = \frac{1}{1 + \exp(-z_c^{(i)})}$$

Y en este caso, el costo se calcularía por clase. Debido a que los parámeros para cada clase no interactuan entre si, la minimozación de cada uno de los costos, implica la minimozación de la sua de los costos, por lo que se podría establecer un costo único de la forma

$$ J(\theta) = J(\theta_1, \ldots, \theta_K) = \frac{1}{T}\sum_{c=1}^K \sum_{i=1}^T -y^{(i)}_c \log(\hat{y}^{(i)}_c) - (1 - y^{(i)}_c) \log((1 - \hat{y}^{(i)}_c)) $$

despues de algunos acomodos utilizando algebra lineal, podemos expresar el gradiente como

$$ \nabla J(\theta) = - \frac{1}{T} X^T (Y - \hat{Y}) $$

que si bien parece identico al utilizado por el algoritmo de regresión softmax, la forma en que $\hat{Y}$ se calcula es fundamentalmente diferente. Es de notar que la función logística es más sencilla y numéricamente más estable que la fución softmax.

Ejercicio 6. Desarrolla todas las funciones para realizar la regresión logística en forma "one vs all", utilizalo para clasificar la base de datos y compara los resultados con los obtenidos utilizando regresión softmax (30 puntos).


In [13]:
"""
En esta tarea no se anexa ninguna función, ni base de pruebas, 
ya que se requiere relativamente pocos cambios a las funciones 
ya desarrolladas con anterioridad.
"""
#--------------------------------------------------------------------------------
# AGREGA AQUI TU CÓDIGO
#--------------------------------------------------------------------------------
def logistica_1vsALL(z):
    
    return 1.0/(1 + np.exp(-z))

def costo_1vsALL(theta, x, y):
    yhat = logistica_1vsALL(x.dot(theta))
    return (1.0/x.shape[0])*(np.sum(-y*np.log(yhat) - (1-y)*np.log(1-yhat)) )
    

def gradiente_1vsALL(theta, x, y):
    return -1.0*(x.T.dot(y - logistica_1vsALL(x.dot(theta))))/x.shape[0]

In [8]:
def dg_softmax_lotes1vsALL(theta, x, y, alpha=None, max_epoch=10000, epsilon=1e-3, errores=False):
    """
    Descenso de gradiente por lotes para la clasificación softmax
    
    """
    historial = np.zeros((max_epoch)) if errores else None
    for epoch in xrange(max_epoch):
        #--------------------------------------------------------------------------------
        # AGREGA AQUI TU CÓDIGO
        #--------------------------------------------------------------------------------
        inc = gradiente_1vsALL(theta, x, y)
        if np.abs(inc.max()) <= epsilon:
            return theta, historial
        theta -= alpha*inc
        if errores:
            historial[epoch] = costo_1vsALL(theta, x, y)

        #--------------------------------------------------------------------------------
    return theta, historial

In [28]:
# Ajusta un valor de alpha razonable

alfita = .7

T, K = y.shape
n = x.shape[1]

theta = 0.1 * (np.random.random((n + 1, K)) - 0.5)
theta, e_hist = dg_softmax_lotes1vsALL(theta, extendida(x), y, alpha=alfita, max_epoch=100, errores=True)
plt.plot(e_hist)


Out[28]:
[<matplotlib.lines.Line2D at 0x7f15b78cca10>]

In [30]:
print "El costo de la solución final es de ", costo_1vsALL(theta, extendida(x), y)

y_estimada = predice(theta, extendida(x))

errores = np.where(y.argmax(axis=1) == y_estimada.argmax(axis=1), 0, 1)

print "\nLos datos utilizados para el aprendizaje mal clasificados son el ", 100 * errores.mean(),"%"

# Esto solo es para hacerla más emocionante
x_test = data['X_valida']
y_test = data['T_valida']
y_estimada_T = predice(theta, extendida(x_test))
errores = np.where(y_test.argmax(axis=1) == y_estimada_T.argmax(axis=1), 0, 1)

print "\nY con los datos de pureba el error es del ", 100 * errores.mean(),"%"


El costo de la solución final es de  0.509454272978
[[ 1.  0.  0. ...,  0.  0.  0.]
 [ 0.  1.  0. ...,  0.  0.  0.]
 [ 0.  0.  1. ...,  0.  0.  0.]
 ..., 
 [ 0.  0.  0. ...,  1.  0.  0.]
 [ 0.  0.  0. ...,  0.  1.  0.]
 [ 0.  0.  0. ...,  0.  0.  1.]]

Los datos utilizados para el aprendizaje mal clasificados son el  5.2 %
[[ 1.  0.  0. ...,  0.  0.  0.]
 [ 0.  1.  0. ...,  0.  0.  0.]
 [ 0.  0.  1. ...,  0.  0.  0.]
 ..., 
 [ 0.  0.  0. ...,  1.  0.  0.]
 [ 0.  0.  0. ...,  0.  1.  0.]
 [ 0.  1.  0. ...,  0.  0.  0.]]

Y con los datos de pureba el error es del  6.8 %

In [ ]: